Meta sues maker of explicit deepfake app for dodging its rules to advertise AI ‘nudifying' tech

Meta is suing the Hong Kong-based maker of the app CrushAI, a platform capable of creating sexually explicit deepfakes, claiming that it repeatedly circumvented the social media company's rules to purchase ads.
The suit is part of what Meta (META) described as a wider effort to crack down on so-called 'nudifying' apps — which allow users to create nude or sexualized images from a photo of someone's face, even without their consent — following claims that the social media giant was failing to adequately address ads for those services on its platforms.
As of February, the maker of CrushAI, also known as Crushmate and by several other names, had run more than 87,000 ads on Meta platforms that violated its rules, according to the complaint Meta filed in Hong Kong district court Thursday.
Meta alleges the app maker, Joy Timeline HK Limited, violated its rules by creating a network of at least 170 business accounts on Facebook or Instagram to buy the ads. The app maker also allegedly had more than 55 active users managing over 135 Facebook pages where the ads were displayed. The ads primarily targeted users in the United States, Canada, Australia, Germany and the United Kingdom.
'Everyone who creates an account on Facebook or uses Facebook must agree to the Meta Terms of Service,' the complaint states.
Some of those ads included sexualized or nude images generated by artificial intelligence and were captioned with phrases like 'upload a photo to strip for a minute' and 'erase any clothes on girls,' according to the lawsuit.
CNN has reached out to Joy Timeline HK Limited for comment on the lawsuit.
Tech platforms face growing pressure to do more to address non-consensual, explicit deepfakes, as AI makes it easier than ever to create such images. Targets of such deepfakes have included prominent figures such as Taylor Swift and Rep. Alexandria Ocasio-Cortez, as well as high school girls across the United States. The Take It Down Act, which makes it illegal for individuals to share non-consensual, explicit deepfakes online and requires tech platforms to quickly remove them, was signed into law last month.
But a series of media reports in recent months suggest that these nudifying AI services have found an audience by advertising on Meta's platforms.
In January, reports from tech newsletter Faked Up and outlet 404Media found that CrushAI had published thousands of ads on Instagram and Facebook and that 90% of the app's traffic was coming from Meta's platforms. That's despite the fact that Meta prohibits ads that contain adult nudity and sexual activity, and forbids sharing non-consensual intimate images and content that promotes sexual exploitation, bullying and harassment.
Following those reports, Sen. Dick Durbin, Democrat and ranking member of the Senate Judiciary Committee, wrote to Meta CEO Mark Zuckerberg asking 'how Meta allowed this to happen and what Meta is doing to address this dangerous trend.'
Earlier this month, CBS News reported that it had identified hundreds of advertisements promoting nudifying apps across Meta's platforms, including ads that featured sexualized images of celebrities. Other ads on the platforms pointed to websites claiming to animate deepfake images of real people to make them appear to perform sex acts, the report stated. In response to that report, Meta said it had 'removed these ads, deleted the Pages responsible for running them and permanently blocked the URLs associated with these apps.'
Meta says it reviews ads before they run on its platforms, but its complaint indicates that it has struggled to enforce its rules. According to the complaint, some of the CrushAI ads blatantly advertised its nudifying capabilities with captions such as 'Ever wish you could erase someone's clothes? Introducing our revolutionary technology' and 'Amazing! This software can erase any clothes.'
Now, Meta said its lawsuit against the CrushAI maker aims to prevent it from further circumventing its rules to place ads on its platforms. Meta alleges it has lost $289,000 because of the costs of the investigation, responding to regulators and enforcing its rules against the app maker.
When it announced the lawsuit Thursday, the company also said it had developed new technology to identify these types of ads, even if the ads themselves didn't contain nudity. Meta's 'specialist teams' partnered with external experts to train its automated content moderation systems to detect the terms, phrases and emojis often present in such ads.
'This is an adversarial space in which the people behind it — who are primarily financially motivated — continue to evolve their tactics to avoid detection,' the company said in a statement. 'Some use benign imagery in their ads to avoid being caught by our nudity detection technology, while others quickly create new domain names to replace the websites we block.'
Meta said it had begun sharing information about nudifying apps attempting to advertise on its sites with other tech platforms through a program called Lantern, run by industry group the Tech Coalition. Tech giants created Lantern in 2023 to share data that could help them fight child sexual exploitation online.
The push to crack down on deepfake apps comes after Meta dialed back some of its automated content removal systems — prompting some backlash from online safety experts. Zuckerberg announced earlier this year that those systems would be focused on checking only for illegal and 'high-severity' violations such as those related to terrorism, child sexual exploitation, drugs, fraud and scams. Other concerns must be reported by users before the company evaluates them.

Try Our AI Features

Explore what Daily8 AI can do for you:

Learn with AIFact CheckingText to SpeechAI Summary

Related Articles

Yahoo

18 minutes ago

• Yahoo

Save Your Batteries, This Solar-Powered Security Camera Is 50% off Right Now

Are you looking to outfit your home with a new smart security camera? While sales events like Prime Day in July are a great time to buy, you can get this excellent Eufy wireless solar-powered 2K security camera today for only $65. The Eufy Solocam S220 is a capable outdoor security camera like any other, only it has a few fancy tricks up its sleeve. You won't have to run a bunch of long power wires or deal with constantly replacing or recharging batteries, something most security cameras struggle with. That's because this outdoor security camera is solar-powered and only needs about three hours of sunlight to keep tabs on your home daily. Eufy's Solocam S220's MSRP is $130, although it is often discounted to under $100. Lucky for you, Amazon just slashed the price by 50%, making this stellar camera only $64.99. So, what does this camera offer, and what can you expect for your money? Well, quite a bit, thankfully. It's easy to mount just about anywhere, although you'll want a spot with plenty of sunshine. Then, pair it with the Eufy app, and you'll get crystal-clear 2K resolution video of all the happenings around your home. While the battery inside is charged by the solar cell, you shouldn't have to deal with it at all. The Eufy Solocam S220 offers night vision thanks to an Infrared LED and movement detection. It also uses AI to detect familiar faces, animals, and more to know when a notification is worth sending. That way, you won't get alerts for a branch blowing in the wind. This outdoor solar-powered security camera only takes about five minutes to install. It has a durable IP67 rating to handle any outdoor conditions, 2-way audio, and custom security zones you can customize in the app, to name a few. More importantly, there's no monthly fee with Eufy, so you buy once and enjoy peace of mind for years to come. If there's a downside, the unit only has 8GB of storage, so storage space is somewhat limited. Either way, this solid camera makes home security a breeze. Grab yours before it sells out.

Yahoo

19 minutes ago

• Yahoo

Lightroom is working on a solution to my most-hated part of photo editing – and I couldn't be more excited

When you buy through links on our articles, Future and its syndication partners may earn a commission. Between taking photos and editing photos sits one of my least favorite parts of photography: culling, or the process of choosing which photos to edit. As a wedding photographer, culling a gallery of several thousand images takes hours of clicking through to find the best shots. But Adobe Lightroom is working on a new tool that could help speed up the culling process. In a teaser on social media, Adobe shared that developers are working on AI filters, a tool that works to recognize throw-away shots, like shots that are out of focus and blinking portraits. The AI filters, like many of the Lightroom tools, use a slider, allowing photographers to control how strictly to apply these auto-selection filters. A clean-up slider will also help remove accidental shutter triggers, as well as shots that are over- or underexposed. The AI will also be able to auto-group similar shots together, like those taken with burst mode. AI culling tools aren't new – but the tools that exist are third-party platforms and plug-ins that add to the growing number of subscriptions. While I hate culling, my growing subscription aversion has prevented me from buying AI culling software. The idea of getting faster culling without another subscription is one that I can get on board with (albeit one that has recently increased in price). I'm a Lightroom Classic user, and many of the latest AI-based tools have saved me a lot of time. If AI can do to culling what subject selection did to masking, then such a tool would save me hours of sifting through photographs. Sometimes, accidental photos end up as happy surprises – an out-of-focus shot that still captures the emotion of the moment, for example. That's why I'm excited by AI-supportive culling that adds speed yet still leaves the photographer in the driver's seat. But where I think AI culling can save the most time is picking the best shot out of several similar images. I spent a lot of time looking at similar photos to find the one that's the sharpest and discarding the close-eye shots. When I chatted with Adobe during the B&H Bild Expo in New York, Adobe indicated the AI filtering would be coming later this year to both Lightroom Classic and Lightroom Desktop. AI-based subject detection has saved me hours on tasks like whitening teeth, without even using generative AI. I have high hopes that the upcoming Lightroom AI Filters tool brings more of the same time-saving shortcuts to culling. Tired of culling too? Browse the best photo culling software. Or, take a look at the best photo editing software.

Yahoo

21 minutes ago

• Yahoo

One dead and four teenagers injured after a quintuple shooting in Milwaukee

Milwaukee police are investigating a quintuple shooting involving teenagers that left one dead and four wounded on Friday, June 20. The incident took place at about 10:50 p.m. on the 8300 block of West Brown Deer Road. The 19-year-old victim sustained fatal gunshot wounds and was pronounced dead at the scene. The other four victims, two 16-year-olds, one 15-year-old and one 14-year-old, all sustained non-fatal gunshot wounds. They were transported to local hospitals for treatment. Their condition was unknown as of June 21. Milwaukee police said the investigation is ongoing, and they continue to seek unknown suspects. Anyone with any information is asked to contact Milwaukee Police at (414) 935-7360 or to remain anonymous, contact Crime Stoppers at (414) 224-Tips or P3 Tips. The incident comes just three days after a quadruple shooting on the 1000 block of West Mineral Street. The victims of that shooting include two 26-year-olds, a 27-year-old and a 34-year-old. All are expected to survive. There have been 251 non-fatal shootings in Milwaukee so far this year, according MPD crime statistics. That is a 6% decrease from 2024, which had 268 total non-fatal shootings by this time last year. This article originally appeared on Milwaukee Journal Sentinel: Quintuple shooting in Milwaukee leaves 1 dead, 4 injured, police say