Can AI image generators be policed to prevent explicit deepfakes of children?

As one of the largest ‘training’ datasets has been found to contain child sexual abuse material, can bans on creating such imagery be feasible?

Child abusers are creating AI-generated “deepfakes” of their targets in order to blackmail them into filming their own abuse, beginning a cycle of sextortion that can last for years.

Creating simulated child abuse imagery is illegal in the UK, and Labour and the Conservatives have aligned on the desire to ban all explicit AI-generated images of real people.

Continue reading...

Creating sexually explicit deepfake images to be made offence in UK

Offenders could face jail if image is widely shared under proposed amendment to criminal justice bill

Creating a sexually explicit “deepfake” image is to be made an offence under a new law, the Ministry of Justice has announced.

Under the legislation, anyone who creates such an image without consent will face a criminal record and an unlimited fine. They could also face jail if the image is shared more widely.

Continue reading...

Nearly 4,000 celebrities found to be victims of deepfake pornography

Channel 4 News finds 255 British people including its presenter Cathy Newman to have been doctored into explicit images

More than 250 British celebrities are among the thousands of famous people who are victims of deepfake pornography, an investigation has found.

A Channel 4 News analysis of the five most visited deepfake websites found almost 4,000 famous individuals were listed, of whom 255 were British.

Continue reading...

Revealed: the names linked to ClothOff, the deepfake pornography app

Exclusive: Guardian investigation for podcast series Black Box reveals names connected to app that generated nonconsensual images of underage girls around the world

The first Miriam al-Adib learned of the pictures was when she returned home from a business trip. “Mum,” said her daughter. “I want to show you something.”

The girl, 14, opened her phone to show an explicit image of herself. “It’s a shock when you see it,” said Adib, a gynaecologist in the southern Spanish town of Almendralejo and a mother of four daughters. “The image is completely realistic … If I didn’t know my daughter’s body, I would have thought that image was real.”

Continue reading...

Iran-backed hackers interrupt UAE TV streaming services with deepfake news

Microsoft analysts cite reports saying disruption by group known as Cotton Sandstorm also reached audiences in UK and Canada

Iranian state-backed hackers interrupted TV streaming services in the United Arab Emirates to broadcast a deepfake newsreader delivering a report on the war in Gaza, according to analysts at Microsoft.

The tech company said a hacking operation run by the Islamic Revolutionary Guards, a key branch of the Iranian armed forces, had disrupted streaming platforms in the UAE with an AI-generated news broadcast branded “For Humanity”.

Continue reading...

Company worker in Hong Kong pays out £20m in deepfake video call scam

Police investigate after employee says she was tricked into sending money to fraudsters posing as senior officers at her firm

Hong Kong police have launched an investigation after an employee at an unnamed company claimed she was duped into paying HK$200m (£20m) of her firm’s money to fraudsters in a deepfake video conference call.

The Hong Kong police force said it had received a report from a worker that she had been tricked into transferring the money by someone “posing as senior officers of the company”.

Continue reading...

Disinformation attacks targeted voters, media and LGBTQ+ groups, EU report finds

Digital ‘warfare’ included manipulating voices and images of celebrities such as Margot Robbie and Nicolas Cage

Disinformation attacks in 2023 targeted European democracy but also media outlets and LGBTQ+ organisations, and involved the malicious manipulation of the images and voices of celebrities such as Margot Robbie and Nicolas Cage, an EU report has concluded.

The research, the EU’s second annual disinformation report, lifts the lid on digital weaponry deployed to undermine Ukraine, but also to spread fake news during elections in Poland and Spain.

Continue reading...

Dick Smith criticises Facebook after scammers circulate deepfake video ad

Businessman warns people to ‘never ever’ purchase from advertisers on Facebook and Instagram after ‘totally fraudulent’ video appears

Australian businessman Dick Smith has urged people to stop buying anything from Facebook or Instagram after a deepfake video of him spruiking an investment opportunity was circulated by scammers online.

Smith posted a message on his personal website on Monday afternoon about the video, which was designed to appear like a segment on A Current Affair, featuring host Ally Langdon apparently interviewing him, Gina Rinehart and Andrew Forrest.

Sign up for Guardian Australia’s free morning and afternoon email newsletters for your daily news roundup

Continue reading...