Child sexual abuse content growing online with AI-made images, report says

More children and families extorted with AI-made photos and videos, says National Center for Missing and Exploited Children

Child sexual exploitation is on the rise online and taking new forms such as images and videos generated by artificial intelligence, according to an annual assessment released on Tuesday by the National Center for Missing & Exploited Children (NCMEC), a US-based clearinghouse for the reporting of child sexual abuse material.

Reports to the NCMEC of child abuse online rose by more than 12% in 2023 compared with the previous year, surpassing 36.2m reports, the organization said in its annual CyberTipline report. The majority of tips received were related to the circulation of child sexual abuse material (CSAM) such as photos and videos, but there was also an increase in reports of financial sexual extortion, when an online predator lures a child into sending nude images or videos and then demands money.

Continue reading...

Canada school boards accuse social media firms of ‘rewiring’ how kids think

District education authorities launch multibillion-dollar lawsuit against Meta, Snap Inc and ByteDance

Four of Canada’s largest school boards have launched a multibillion-dollar lawsuit against the social media companies Meta, Snap Inc and ByteDance, accusing them of acting in a “high-handed, reckless, malicious, and reprehensible manner” with products the boards claim harm student learning and “rewire” how children think.

The four district boards – Ottawa-Carleton, Toronto, Peel and Toronto Catholic – filed four separate statements of claim in Ontario’s superior court of justice on Wednesday.

Continue reading...

EU calls on tech firms to outline plans to tackle deepfakes amid election fears

Move involving companies such as Google, Facebook and X comes after evidence of Russian online interference in polls

The EU is calling on eight major tech companies including Google, Facebook and X to detail how they identify and tackle deepfake material amid concerns about the use of the technology to influence elections.

In a world first, they will be using new laws on artificial intelligence to force companies to root out fake video, imagery and audio.

Continue reading...

‘It was forced’: grieving parents unfazed by sorry tech CEOs at US Senate hearing

Many parents held up images of the children who died after falling prey to abusers on apps such as Instagram, TikTok and Snapchat

Mark Zuckerberg apologized to the parents of children who killed themselves after being subjected to online sexual exploitation during a US Senate hearing Wednesday. Evan Spiegel offered condolences to parents whose children obtained deadly illegal drugs via Snapchat. The words were too little, too late for their intended audience, though. The grieving guardians expressed only frustration with the social media CEOs’ responses to their plight and to questions from members of Congress.

“I’m not happy with the answers the CEOs are giving. They can’t give a straight answer. Not even ‘yes’ or ‘no,’” said Tammy Rodriguez, the mother of Selena Rodriguez, who was 11 when she died by suicide three years ago after being solicited for sexually exploitative content by strangers on Instagram and Snapchat.

Continue reading...

‘An ideal tool for a repressive regime’: Snapchat’s Saudi ties questioned

Critics say social media app – partly owned by a Saudi investor – pushes pro-crown prince hype while critical voices are punished

Saudi Arabia appears to be exploiting the US messaging app Snapchat to promote the image of its crown prince, Mohammed bin Salman, while also imposing draconian sentences on influencers who use the platform to post even mild criticism of the future king.

The California-based company, which last year agreed to a “collaboration” with the Saudi culture ministry, has more than 20 million users in the kingdom – including an estimated 90% of 13-to-34-year-olds – and the crown prince has met personally with some of the platform’s biggest “Snapchatters” for informal talks about current events, according to people familiar with the encounters.

Continue reading...

Saudi Arabia warns Snapchat users that ‘insulting’ regime is a criminal offense

Users of the social media app have faced legal consequences for posts – some private – that are critical of Saudi authorities

Saudi state media issued an explicit warning that it is a criminal offense to “insult” authorities using social media apps such as Snapchat, the California-based messaging app whose chief executive recently forged a new “cooperation” deal with the kingdom’s culture ministry.

The threat – which was originally televised in April and then deleted – has gained new resonance as more cases emerge in which Snapchat users and influencers in the kingdom have been arrested by authorities and, in some cases, sentenced to decades-long prison sentences.

Continue reading...

EU lawyers say plan to scan private messages for child abuse may be unlawful

Under proposed ‘chat controls’ regulation, any encrypted service provider could be forced to screen for ‘identifiers’

An EU plan under which all WhatsApp, iMessage and Snapchat accounts could be screened for child abuse content has hit a significant obstacle after internal legal advice said it would probably be annulled by the courts for breaching users’ rights.

Under the proposed “chat controls” regulation, any encrypted service provider could be forced to survey billions of messages, videos and photos for “identifiers” of certain types of content where it was suspected a service was being used to disseminate harmful material.

Continue reading...

Child abuse image offences in UK have soared, NSPCC report shows

Charity says police recording has improved but online grooming has risen and tech firms are failing to act

Police have recorded a surge in child abuse image offences in the UK, with more than 30,000 reported in the most recent year, according to a report from the NSPCC.

That is an increase of more than 66% on figures from five years ago, when police forces across the country recorded 18,574 such offences.

Continue reading...

Social platforms set advertising rules on Indigenous voice for Australia’s first referendum in digital age

Warren Mundine, a leading critic of voice to parliament, is concerned advertising from main referendum campaigns may be removed by platforms

Major online platforms are setting their transparency and misinformation rules for Australia’s first referendum in the digital age, as Warren Mundine, a prominent member of the no campaign, calls for advertising about the Indigenous voice to parliament referendum to run unrestricted.

Facebook, Instagram and Snapchat will require all paid ads for the voice referendum to carry authorisation messages like those at elections, and will fact-check ads and remove those rated as false.

Continue reading...

Seattle public schools sue social media platforms for youth ‘mental health crisis’

Lawsuit accuses companies behind TikTok, Facebook, Instagram, Snapchat and YouTube of harming young people’s mental health

Seattle’s public schools district has filed a lawsuit in the US against multiple major social media companies, accusing them of harming young people’s mental health across the country.

The lawsuit which was filed on Friday with a US district court accused the social media companies behind TikTok, Facebook, Instagram, Snapchat and YouTube of creating a “mental health crisis among America’s youth”.

Continue reading...

Shares in Snapchat owner slump 25% amid slowdown in ad revenue

Parent company Snap talks of ‘incredibly challenging’ conditions as it seeks new sources of revenue

Shares in Snapchat’s parent company have fallen 25% after it confirmed investors’ fears of a slowdown in advertising revenue for social media firms.

Snap painted a grim picture of the effects of a weakening economy on social media in quarterly results on Thursday and declined to make a revenue forecast in “incredibly challenging” conditions, hitting its share price in after hours trading and setting off a chain reaction among listed rivals.

Continue reading...

Snapchat fights drug dealing on app amid surge in youth overdose deaths

Improved automated drug detection systems and enhanced partnerships with law enforcement are among changes

Snapchat has announced new efforts to combat drug dealing on the platform, changes that come as drug-related deaths among US high school and college-aged youth are exploding.

The company said it has improved automated drug detection systems, enhanced partnerships with law enforcement, and launched a new portal educating users on the dangers of drugs.

Erin McCormick contributed reporting

Continue reading...

‘I have moments of shame I can’t control’: the lives ruined by explicit ‘collector culture’

The swapping, collating and posting of nude images of women without their consent is on the rise. But unlike revenge porn, it is not a crime. Now survivors are demanding a change in the law

Ruby will never forget the first time she clicked on the database AnonIB. It is a so-called “revenge porn” site and in January 2020, a friend had texted her for help. Ruby is a secondary school teacher, used to supporting teenagers, and her friend turned to her for advice when she discovered her images were on the site.

“She didn’t send the thread that she was on,” says Ruby, 29. “She was embarrassed, so she sent a general link to the site itself.” When Ruby opened it, “I couldn’t believe what I was seeing. I couldn’t believe that such an infrastructure existed: something so well organised, so systematic, fed by the people who lived around us.”

Continue reading...

Killed by a pill bought on Snapchat: the counterfeit drugs poisoning US teens

Accidental deaths soar among young people amid a proliferation of fentanyl-filled pharmaceuticals

Fourteen-year-old Alondra Salinas had set out her new white sneakers and packed her backpack the night before the first day of in-person high school when police say she responded to an offer on Snapchat for blue pills, which turned out to be deadly fentanyl. Her mother couldn’t wake her the next morning.

Seventeen-year-old Zachary Didier was waiting to hear back on his college applications when a fake Percocet killed him. Sammy Berman Chapman, a 16-year-old straight-A student, died in his bedroom after taking what he thought was a single Xanax.

Continue reading...

‘I’m happy to lose £10m by quitting Facebook,’ says Lush boss

Losing 10m followers on sites such as Instagram is a price worth paying for co-founder of ethical beauty empire

Quitting social media is hard to do, even when it doesn’t cost you anything. So when Lush’s chief executive, Mark Constantine, shut its thousands of Facebook, Instagram, Snapchat and TikTok accounts on Friday, the biggest shopping day of the year, he knew dropping off millions of customers’ screens would damage his business.

Its Facebook and Instagram accounts alone had 10.6 million followers and the void will result in an estimated £10m hit to sales but Constantine, one of the business’s co-founders, said it had “no choice” after whistleblowers called attention to the negative impact social media sites such as Instagram are having on teenagers’ mental health.

Continue reading...

Facebook to suspend Trump’s account for two years

Decision follows oversight board recommendation over ex-president’s post on Capitol attack

Facebook is suspending Donald Trump’s account for two years, the company has announced in a highly anticipated decision that follows months of debate over the former president’s future on social media.

“Given the gravity of the circumstances that led to Mr Trump’s suspension, we believe his actions constituted a severe violation of our rules which merit the highest penalty available under the new enforcement protocols. We are suspending his accounts for two years, effective from the date of the initial suspension on January 7 this year,” Nick Clegg, Facebook’s vice-president of global affairs, said in a statement on Friday.

Continue reading...

Opinion divided over Trump’s ban from social media

Actions spark debate on free speech and whether chief executives of tech firms are fit to act as judge and jury

As rioters were gathering around the US Capitol last Wednesday, a familiar question began to echo around the offices of the large social networks: what should they do about Donald Trump and his provocative posts?

The answer has been emphatic: ban him.

Continue reading...

Most girls and young women have experienced abuse online, report finds

Cyberstalking, body shaming and being sent explicit content among issues highlighted by Plan International

Most girls and young women using social media have experienced abuse that has driven them offline and left them traumatised, according to a new global survey.

More than half of the 14,000 15- to 25-year-olds interviewed by Plan International said they had been cyberstalked, sent explicit messages and images, or abused online.

Continue reading...

US could ban ‘addictive’ autoplay videos and infinite scrolling online

Senator says bill aims to tackle features that ‘capture attention by using psychological tricks’

Autoplaying videos on YouTube, Facebook’s infinite newsfeed and Snapstreaks could be banned in the US under a proposed new bill.

The Social Media Addiction Reduction Technology (Smart) Act takes aim at techniques and features that, according to its author, Republican Senator Josh Hawley, are created to encourage and deepen addictive behaviours.

Continue reading...