Meta sues maker of explicit deepfake app for dodging its rules to advertise AI ‘nudifying' tech
Meta is suing the Hong Kong-based maker of the app CrushAI, a platform capable of creating sexually explicit deepfakes, claiming that it repeatedly circumvented the social media company's rules to purchase ads.
The suit is part of what Meta (META) described as a wider effort to crack down on so-called 'nudifying' apps — which allow users to create nude or sexualized images from a photo of someone's face, even without their consent — following claims that the social media giant was failing to adequately address ads for those services on its platforms.
As of February, the maker of CrushAI, also known as Crushmate and by several other names, had run more than 87,000 ads on Meta platforms that violated its rules, according to the complaint Meta filed in Hong Kong district court Thursday.
Meta alleges the app maker, Joy Timeline HK Limited, violated its rules by creating a network of at least 170 business accounts on Facebook or Instagram to buy the ads. The app maker also allegedly had more than 55 active users managing over 135 Facebook pages where the ads were displayed. The ads primarily targeted users in the United States, Canada, Australia, Germany and the United Kingdom.
'Everyone who creates an account on Facebook or uses Facebook must agree to the Meta Terms of Service,' the complaint states.
Some of those ads included sexualized or nude images generated by artificial intelligence and were captioned with phrases like 'upload a photo to strip for a minute' and 'erase any clothes on girls,' according to the lawsuit.
CNN has reached out to Joy Timeline HK Limited for comment on the lawsuit.
Tech platforms face growing pressure to do more to address non-consensual, explicit deepfakes, as AI makes it easier than ever to create such images. Targets of such deepfakes have included prominent figures such as Taylor Swift and Rep. Alexandria Ocasio-Cortez, as well as high school girls across the United States. The Take It Down Act, which makes it illegal for individuals to share non-consensual, explicit deepfakes online and requires tech platforms to quickly remove them, was signed into law last month.
But a series of media reports in recent months suggest that these nudifying AI services have found an audience by advertising on Meta's platforms.
In January, reports from tech newsletter Faked Up and outlet 404Media found that CrushAI had published thousands of ads on Instagram and Facebook and that 90% of the app's traffic was coming from Meta's platforms. That's despite the fact that Meta prohibits ads that contain adult nudity and sexual activity, and forbids sharing non-consensual intimate images and content that promotes sexual exploitation, bullying and harassment.
Following those reports, Sen. Dick Durbin, Democrat and ranking member of the Senate Judiciary Committee, wrote to Meta CEO Mark Zuckerberg asking 'how Meta allowed this to happen and what Meta is doing to address this dangerous trend.'
Earlier this month, CBS News reported that it had identified hundreds of advertisements promoting nudifying apps across Meta's platforms, including ads that featured sexualized images of celebrities. Other ads on the platforms pointed to websites claiming to animate deepfake images of real people to make them appear to perform sex acts, the report stated. In response to that report, Meta said it had 'removed these ads, deleted the Pages responsible for running them and permanently blocked the URLs associated with these apps.'
Meta says it reviews ads before they run on its platforms, but its complaint indicates that it has struggled to enforce its rules. According to the complaint, some of the CrushAI ads blatantly advertised its nudifying capabilities with captions such as 'Ever wish you could erase someone's clothes? Introducing our revolutionary technology' and 'Amazing! This software can erase any clothes.'
Now, Meta said its lawsuit against the CrushAI maker aims to prevent it from further circumventing its rules to place ads on its platforms. Meta alleges it has lost $289,000 because of the costs of the investigation, responding to regulators and enforcing its rules against the app maker.
When it announced the lawsuit Thursday, the company also said it had developed new technology to identify these types of ads, even if the ads themselves didn't contain nudity. Meta's 'specialist teams' partnered with external experts to train its automated content moderation systems to detect the terms, phrases and emojis often present in such ads.
'This is an adversarial space in which the people behind it — who are primarily financially motivated — continue to evolve their tactics to avoid detection,' the company said in a statement. 'Some use benign imagery in their ads to avoid being caught by our nudity detection technology, while others quickly create new domain names to replace the websites we block.'
Meta said it had begun sharing information about nudifying apps attempting to advertise on its sites with other tech platforms through a program called Lantern, run by industry group the Tech Coalition. Tech giants created Lantern in 2023 to share data that could help them fight child sexual exploitation online.
The push to crack down on deepfake apps comes after Meta dialed back some of its automated content removal systems — prompting some backlash from online safety experts. Zuckerberg announced earlier this year that those systems would be focused on checking only for illegal and 'high-severity' violations such as those related to terrorism, child sexual exploitation, drugs, fraud and scams. Other concerns must be reported by users before the company evaluates them.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
11 minutes ago
- Yahoo
Frequency Electronics (NASDAQ:FEIM) delivers shareholders splendid 56% CAGR over 3 years, surging 15% in the last week alone
The worst result, after buying shares in a company (assuming no leverage), would be if you lose all the money you put in. But in contrast you can make much more than 100% if the company does well. For instance the Frequency Electronics, Inc. (NASDAQ:FEIM) share price is 200% higher than it was three years ago. How nice for those who held the stock! On top of that, the share price is up 31% in about a quarter. Since the stock has added US$27m to its market cap in the past week alone, let's see if underlying performance has been driving long-term returns. This technology could replace computers: discover the 20 stocks are working to make quantum computing a reality. To quote Buffett, 'Ships will sail around the world but the Flat Earth Society will flourish. There will continue to be wide discrepancies between price and value in the marketplace...' One flawed but reasonable way to assess how sentiment around a company has changed is to compare the earnings per share (EPS) with the share price. During three years of share price growth, Frequency Electronics moved from a loss to profitability. Given the importance of this milestone, it's not overly surprising that the share price has increased strongly. The company's earnings per share (over time) is depicted in the image below (click to see the exact numbers). It's probably worth noting that the CEO is paid less than the median at similar sized companies. It's always worth keeping an eye on CEO pay, but a more important question is whether the company will grow earnings throughout the years. Before buying or selling a stock, we always recommend a close examination of historic growth trends, available here.. As well as measuring the share price return, investors should also consider the total shareholder return (TSR). The TSR is a return calculation that accounts for the value of cash dividends (assuming that any dividend received was reinvested) and the calculated value of any discounted capital raisings and spin-offs. Arguably, the TSR gives a more comprehensive picture of the return generated by a stock. In the case of Frequency Electronics, it has a TSR of 278% for the last 3 years. That exceeds its share price return that we previously mentioned. And there's no prize for guessing that the dividend payments largely explain the divergence! It's good to see that Frequency Electronics has rewarded shareholders with a total shareholder return of 152% in the last twelve months. Of course, that includes the dividend. That's better than the annualised return of 26% over half a decade, implying that the company is doing better recently. Given the share price momentum remains strong, it might be worth taking a closer look at the stock, lest you miss an opportunity. I find it very interesting to look at share price over the long term as a proxy for business performance. But to truly gain insight, we need to consider other information, too. Consider for instance, the ever-present spectre of investment risk. We've identified 1 warning sign with Frequency Electronics , and understanding them should be part of your investment process. Of course Frequency Electronics may not be the best stock to buy. So you may wish to see this free collection of growth stocks. Please note, the market returns quoted in this article reflect the market weighted average returns of stocks that currently trade on American exchanges. Have feedback on this article? Concerned about the content? Get in touch with us directly. Alternatively, email editorial-team (at) article by Simply Wall St is general in nature. We provide commentary based on historical data and analyst forecasts only using an unbiased methodology and our articles are not intended to be financial advice. It does not constitute a recommendation to buy or sell any stock, and does not take account of your objectives, or your financial situation. We aim to bring you long-term focused analysis driven by fundamental data. Note that our analysis may not factor in the latest price-sensitive company announcements or qualitative material. Simply Wall St has no position in any stocks mentioned. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
11 minutes ago
- Yahoo
Adobe a ‘long-term AI winner', says DA Davidson
DA Davidson keeps a Buy rating and $500 price target on Adobe (ADBE) after meeting with its management team. The firm has come away incrementally more positive about the company's commercially safe approach to digital content generation, disciplined expense management, and top line resiliency, the analyst tells investors in a research note. The firm views Adobe as a long-term AI-winner with the current price representing an attractive entry point for a category leader with best in class margins. Easily unpack a company's performance with TipRanks' new KPI Data for smart investment decisions Receive undervalued, market resilient stocks right to your inbox with TipRanks' Smart Value Newsletter Published first on TheFly – the ultimate source for real-time, market-moving breaking financial news. Try Now>> See Insiders' Hot Stocks on TipRanks >> Read More on ADBE: Disclaimer & DisclosureReport an Issue Infosys, Adobe partner to utilize AI for marketing life cycle Adobe's Strategic Positioning and Strong Financial Performance Drive Positive Outlook Adobe's Strong Financial Performance and AI-Driven Growth Justify Buy Rating Adobe price target lowered to $450 from $465 at Citi Adobe price target lowered to $500 from $600 at Argus 擷取數據時發生錯誤 登入存取你的投資組合 擷取數據時發生錯誤 擷取數據時發生錯誤 擷取數據時發生錯誤 擷取數據時發生錯誤
Yahoo
12 minutes ago
- Yahoo
Couchbase jumps 28% after agreeing to be acquired for $24.50 per share
Shares of Couchbase (BASE) have jumped $5.40, or 28.5%, to $24.33 after the company announced a definitive agreement to be acquired by Haveli Investments for $24.50 per share in an all-cash transaction valued at approximately $1.5B. Some other names in the cloud-based database platforms, NoSQL database, data storage, an infrastructure software space include MongoDB (MDB), DigitalOcean (DOCN), Elastic (ESTC) and Datadog (DDOG). Easily unpack a company's performance with TipRanks' new KPI Data for smart investment decisions Receive undervalued, market resilient stocks right to your inbox with TipRanks' Smart Value Newsletter Published first on TheFly – the ultimate source for real-time, market-moving breaking financial news. Try Now>> See the top stocks recommended by analysts >> Read More on BASE: Disclaimer & DisclosureReport an Issue Couchbase to be acquired by Haveli Investments for $1.5B in cash Couchbase stockholders to receive $24.50 per share in cash in go-private deal Uber initiated, Etsy downgraded: Wall Street's top analyst calls Couchbase, Inc. Reports Strong Growth Amid Challenges Couchbase's Strong Performance and Positive Outlook: A Buy Recommendation by Jason Ader Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
