Skip to main content
Tech

New lawsuit filed over AI-powered deepfake nude websites


San Francisco filed a lawsuit against 16 AI-powered websites, marking the first government action to combat non-consensual deepfake pornography. The case aims to shut down these websites, which allow users to create AI-generated nude images without consent.

Media Landscape

See who else is reporting on this story and which side of the political spectrum they lean. To read other sources, click on the plus signs below. Learn more about this data
Left 44% Center 42% Right 15%
Bias Distribution Powered by Ground News

The sites collectively received more than 200 million visits in the first half of 2024.

Users can upload photos of fully clothed individuals, including children, which are then manipulated by AI to create non-consensual nude images.

QR code for SAN app download

Download the SAN app today to stay up-to-date with Unbiased. Straight Facts™.

Point phone camera here

Individuals used the technology to create deepfake nudes of people ranging from singer Taylor Swift to Rep. Alexandria Ocasio-Cortez, and everyday citizens like middle-school girls.

In Beverly Hills, California, school administrators expelled five eighth-graders for creating and sharing AI-generated nude images of 16 female classmates.

Victims of these AI-generated nudes often face severe psychological trauma, damaged reputations, and in some cases, suicidal thoughts.

The pervasive nature of online content makes it exceptionally challenging for victims to trace the origin of their manipulated images.

“This is an enormous national and global problem,” Yvonne Mere, San Francisco’s chief deputy attorney, said. “Businesses and websites that conduct these malicious practices have evaded enforcement. Individual victims of this conduct have little practical and legal recourse. It’s very difficult for victims to determine what websites are used to nudify their images because these images don’t have any unique or identifying marks that links you back to the websites.”

The lawsuit, filed on behalf of Californians, alleges violations of state and federal laws against deepfake and revenge pornography and child exploitation.

It seeks to permanently restrain those operating the websites from creating deepfake pornography in the future and assess civil penalties.

Tags: , , , ,

[LAUREN TAYLOR]

SAN FRANCISCO HAS FILED A GROUNDBREAKING LAWSUIT AGAINST 16 AI-POWERED WEBSITES MARKING THE FIRST GOVERNMENT ACTION TO COMBAT NON-CONSENSUAL DEEPFAKE PORNOGRAPHY.

THE CASE AIMS TO SHUT DOWN THESE WEBSITES WHICH ALLOW USERS TO CREATE AI-GENERATED NUDE IMAGES WITHOUT CONSENT.

THE SITES COLLECTIVELY RECEIVED MORE THAN 200 MILLION VISITS IN JUST THE FIRST HALF OF 2024.

USERS CAN UPLOAD PHOTOS OF FULLY CLOTHED INDIVIDUALS, INCLUDING CHILDREN, WHICH ARE THEN MANIPULATED BY AI TO CREATE NON-CONSENSUAL NUDE IMAGES.

THE TECHNOLOGY HAS BEEN USED TO CREATE DEEPFAKE NUDES OF EVERYONE FROM AMERICAN SINGER TAYLOR SWIFT TO CONGRESSWOMAN ALEXANDRIA OCASIO-CORTEZ EVERYDAY CITIZENS LIKE MIDDLE-SCHOOL GIRLS, HIGHLIGHTING THE WIDESPREAD NATURE OF THIS ISSUE.

IN BEVERLY HILLS, CALIFORNIA, FIVE EIGHTH-GRADERS WERE EXPELLED FOR CREATING AND SHARING AI-GENERATED NUDE IMAGES OF 16 FEMALE CLASSMATES.

VICTIMS OF THESE AI-GENERATED NUDES OFTEN FACE SEVERE PSYCHOLOGICAL TRAUMA, DAMAGED REPUTATIONS, AND IN SOME CASES, SUICIDAL THOUGHTS.

THE PERVASIVE NATURE OF ONLINE CONTENT MAKES IT EXCEPTIONALLY CHALLENGING FOR VICTIMS TO TRACE THE ORIGIN OF THEIR MANIPULATED IMAGES.

[YVONNE MERE]

“THIS IS AN ENORMOUS NATIONAL AND GLOBAL PROBLEM. BUSINESSES AND WEBSITES THAT CONDUCT THESE MALICIOUS PRACTICES HAVE EVADED ENFORCEMENT. INDIVIDUAL VICTIMS OF THIS CONDUCT HAVE LITTLE PRACTICAL AND LEGAL RECOURSE. IT’S VERY DIFFICULT FOR VICTIMS TO DETERMINE WHAT WEBSITES ARE USED TO NUDIFY THEIR IMAGES BECAUSE THESE IMAGES DON’T HAVE ANY UNIQUE OR IDENTIFYING MARKS THAT LINKS YOU BACK TO THE WEBSITES.”

[LAUREN TAYLOR]

THE LAWSUIT, FILED ON BEHALF OF CALIFORNIANS, ALLEGES VIOLATIONS OF STATE AND FEDERAL LAWS AGAINST DEEPFAKE AND REVENGE PORNOGRAPHY, AND CHILD EXPLOITATION.

IT SEEKS TO PERMANENTLY RESTRAIN THOSE OPERATING THE WEBSITES FROM CREATING DEEPFAKE PORNOGRAPHY IN THE FUTURE AND ASSESS CIVIL PENALTIES.

FOR STRAIGHT ARROW NEWS, I’M LAUREN TAYLOR..