BREAKING: Judge orders release of Mahmoud Khalil

Tech News
Accounts peddling child abuse content flood some X hashtags as safety partner cuts ties
Thorn, a nonprofit that provides detection and moderation software related to child safety, said it canceled its contract with X after the platform stopped paying it.
June 18, 2025, 4:57 PM EDT / Updated June 18, 2025, 5:58 PM EDT
By Ben Goggin
When Elon Musk took over Twitter in 2022, he said that addressing the problem of child sexual abuse material on the platform was his ' top priority.' Three years later, the problem appears to be escalating, as anonymous, seemingly automated X accounts flood hashtags with hundreds of posts per hour advertising the sale of the illegal material.
At the same time, Thorn, a California-based nonprofit organization that works with tech companies to provide technology that can detect and address child sexual abuse content, told NBC News that it had terminated its contract with X.
Thorn said that X stopped paying recent invoices for its work, though it declined to provide details about its deal with the company citing legal sensitivities. X said Wednesday that it was moving toward using its own technology to address the spread of child abuse material.
Some of Thorn's tools are designed to address the very issue that appears to be growing on the platform.
'We recently terminated our contract with X due to nonpayment,' Cassie Coccaro, head of communications at Thorn, told NBC News. 'And that was after months and months of outreach, flexibility, trying to make it work. And ultimately we had to stop the contract.'
Many aspects of the child exploitation ads issue, which NBC News first reported on in January 2023, remain the same on the platform. Sellers of child sexual abuse material (CSAM) continue to use hashtags based on sexual keywords to advertise to people looking to buy CSAM. Their posts direct prospective buyers to other platforms where users are asked for money in return for the child abuse material.
Other aspects are new: Some accounts now appear to be automated (also known as bots), while others have taken advantage of 'Communities,' a relatively new feature launched in 2021 that encourages X users to congregate in groups 'closer to the discussions they care about most.' Using Communities, CSAM advertisers have been able to post into groups of tens of thousands of people devoted to topics like incest, seemingly without much scrutiny.
The Canadian Centre for Child Protection (C3P), an independent online CSAM watchdog group, reviewed several X accounts and hashtags flagged by NBC News that were promoting the sale of CSAM, and followed links promoted by several of the accounts. The organization said that, within minutes, it was able to identify accounts that posted images of previously identified CSAM victims who were as young as 7. It also found apparent images of CSAM in thumbnail previews populated on X and in links to Telegram channels where CSAM videos were posted. One such channel showed a video of a boy estimated to be as young as 4 being sexually assaulted. NBC News did not view or have in its possession any of the abuse material.
Lloyd Richardson, director of information technology at C3P, said the behavior being exhibited by the X users was 'a bit old hat' at this point, and that X's response 'has been woefully insufficient.' 'It seems to be a little bit of a game of Whac-A-Mole that goes on,' he said. 'There doesn't seem to be a particular push to really get to the root cause of the issue.' X says it has a zero-tolerance policy 'towards any material that features or promotes child sexual exploitation.'
A spokesperson for X directed NBC News to a post from its @Safety account detailing what the company says are new efforts to find and remove child abuse material.
'At X, we have zero tolerance for child sexual exploitation in any form. Until recently, we leveraged partnerships that helped us along the way,' the company said in the post. 'We are proud to provide an important update on our continuous work detecting Child Sexual Abuse Material (CSAM) content, announcing today that we have launched additional CSAM hash matching efforts.
'This system allows X to hash and match media content quickly and securely, keeping the platform safer without sacrificing user privacy,' the post continued. 'This is enabled by the incredible work of our safety engineering team, who have built state of the art systems to further strengthen our enforcement capabilities.'
The company said that the system would allow the company to automatically detect known CSAM and remove it, though it was not clear how it differs from existing hashing technology.
The spokesperson did not respond to questions about Thorn's allegations regarding the payments.
A review of many hashtags with terms known to be associated with CSAM shows that the problem is, if anything, worse than when Musk initially took over. What was previously a trickle of posts of fewer than a dozen per hour is now a torrent propelled by accounts that appear to be automated — some posting several times a minute.
Despite the continued flood of posts and sporadic bans of individual accounts, the hashtags observed by NBC News over several weeks remained open and viewable as of Wednesday. And some of the hashtags that were identified in 2023 by NBC News as hosting the child exploitation advertisements are still being used for the same purpose today.
Historically, Twitter and then X have attempted to block certain hashtags associated with child exploitation. When NBC News first reported on the use of X to market CSAM, X's head of trust and safety said the company knew it had work to do and would be making changes, including the development of automated systems to detect and block hashtags.
In January 2024, X CEO Linda Yaccarino testified to the Senate Judiciary Committee that the company had strengthened its enforcement 'with more tools and technology to prevent bad actors from distributing, searching for, or engaging with [child sexual exploitation] content across all forms of media.'
In May 2024, X said it helped Thorn test a tool to 'proactively detect text-based child sexual exploitation.' The 'self-hosted solution was deployed seamlessly into our detection mechanisms, allowing us to hone in on high-risk accounts and expand child sexual exploitation text detection coverage,' X said.
Pailes Halai, Thorn's senior manager of accounts and partnerships, who oversaw the X contract, said that some of Thorn's software was designed to address issues like those posed by the hashtag CSAM posts, but that it wasn't clear if they ever fully implemented it.
'They took part in the beta with us last year,' he said. 'So they helped us test and refine, etc, and essentially be an early adopter of the product. They then subsequently did move on to being a full customer of the product, but it's not very clear to us at this point how and if they used it.'
Without Thorn, it's not entirely clear what child safety mechanisms X is currently employing. 'Our technology is designed with safety in mind,' Halai said. 'It's up to the platform to enforce and use the technology appropriately … What we do know on our side is it's designed to catch the very harms that you're talking about.'
Halai said Thorn didn't take the termination of its contract with X lightly.
'It was very much a last-resort decision for us to make,' he said. 'We provided the services to them. We did it for as long as we possibly could, exhausted all possible avenues and had to terminate, ultimately, because, as a nonprofit, we're not exactly in the business of helping to sustain something for a company like X, where we're actually incurring huge costs.'
Currently, some hashtags, like #childporn, are blocked when using X's search function, but other hashtags are open to browse and are filled with posts advertising CSAM for sale. NBC News found posts appearing to peddle CSAM in 23 hashtags that are oftentimes used together in the posts. NBC News only identified two hashtags that were blocked by X. The hashtags that were available to be posted to and viewed during an NBC News' review of the platform ranged from references to incest and teenagers to slightly more coded terms, like combinations of words with the name of the defunct video chat platform Omegle, which shut down in 2023 after a child sex exploitation lawsuit. Some hashtags contained jumbled letters and only contained posts advertising CSAM, indicating that they were created with the exclusive purpose of housing the advertisements.
Some usernames of accounts posting the ads were simply a jumble of words associated with CSAM content on the platform, mixing names of social media platforms with other keywords.
Many of the users linked directly to Telegram channels in their posts or their account bios and included explicit references to CSAM. Some posts linked to Discord channels or solicited direct messages to secure Discord links.
Telegram and Discord have distinct positions in the internet's child exploitation ecosystem, offering semiprivate and private venues for people looking to sell or buy child exploitation material. NBC News previously reported on 35 cases in which adults were prosecuted on charges of kidnapping, grooming or sexual assault that allegedly involved communications on Discord.
A Discord representative said, 'Discord has zero tolerance for child sexual abuse material, and we take immediate action when we become aware of it, including removing content, banning users, and reporting to the National Center for Missing and Exploited Children (NCMEC).' The company said in response to NBC News' outreach that it removed multiple servers 'for policy violations unrelated to the sale of CSAM.'
A representative for Telegram said 'CSAM is explicitly forbidden by Telegram's terms of service and such content is removed whenever discovered.' The representative pointed to the company's partnership with the U.K.-based Internet Watch Foundation, which maintains a database of known CSAM and provides tools to detect and remove it.
While some of the X accounts posted publicly, others solicited and offered CSAM through X's Communities feature, where users create groups based on specific topics. NBC News observed groups with tens of thousands of members in which CSAM was solicited or was offered to be sold.
In a group with over 70,000 members devoted to 'incest confessions,' multiple users posted multiple times linking to Telegram channels, explicitly referencing CSAM. 'I'm selling 6cp folder for only 90$,' one user wrote, linking to a Telegram account. CP is a common online abbreviation for 'child pornography.'
CSAM has been a perpetual problem on the internet and social media, with many companies employing specialized teams and building automated systems to identify and remove abuse content and those spreading it.
But Musk also instituted drastic cuts to the company's trust and safety teams and disbanded the company's Trust and Safety Council. In 2023, the company said that it was detecting more CSAM than in previous years and that it had increased staffing devoted to the issue despite larger trust and safety layoffs.
Richardson, C3P's director of information technology, said that while X will sometimes remove accounts that are flagged to it for violating rules around CSAM, 'a new account pops up in two seconds, so there's not a lot of in-depth remediation to the problem. That's just sort of the bare minimum that we're looking at here.'
He said an increasing reliance on artificial intelligence systems for moderation, if X is using them, could be in part to blame for such oversights. According to Richardson, AI systems are good at sorting through large datasets and flagging potential issues, but that, currently, systems will inevitably over- or under-moderate without human judgment at the end.
'There should be an actual incident response when someone is selling child sexual abuse material on your service, right? We've become completely desensitized to that. We're dealing with the sale of children being raped,' Richardson said. 'You can't automate your way out of this problem.'
Ben Goggin
Ben Goggin is the deputy tech editor for NBC News.

Try Our AI Features

Explore what Daily8 AI can do for you:

Learn with AIFact CheckingText to SpeechAI Summary

Related Articles

NBC News

an hour ago

• NBC News

Walmart to pay $10 million to settle lawsuit over money transfer fraud

Walmart has agreed to pay $10 million to settle a U.S. Federal Trade Commission civil lawsuit accusing the world's largest retailer of ignoring warning signs that fraudsters used its money transfer services to fleece consumers out of hundreds of millions of dollars. The settlement was filed on Friday in Chicago federal court, and requires approval by U.S. District Judge Manish Shah. Walmart also agreed not to process money transfers it suspects are fraudulent, or help sellers and telemarketers it believes are using its services to commit fraud. 'Electronic money transfers are one of the most common ways that scammers tell consumers to send them money, because once it's sent, it's gone for good,' said Christopher Mufarrige, director of the FTC consumer protection bureau. 'Companies that provide these services must train their employees to comply with the law and work to protect consumers.' The Arkansas-based retailer did not admit or deny wrongdoing in agreeing to settle. Walmart did not immediately respond to requests for comment. In its June 2022 complaint, the FTC accused Walmart of turning a blind eye to fraudsters who used its money transfer services to cash out at its stores. Walmart acts as an agent for money transfers by companies such as MoneyGram and Western Union. Money can be hard to trace once delivered. The FTC said fraudsters used many schemes that included impersonating Internal Revenue Service agents, impersonating family members who needed money from grandparents to avoid jail, and telling victims they won lotteries or sweepstakes but owed fees to collect their winnings. Shah dismissed part of the FTC case last July but let the regulator pursue the remainder. Walmart appealed from that decision. Friday's settlement would end the appeal.

Reuters

an hour ago

• Reuters

Asus fends off bid to ban US laptop imports in Lenovo patent dispute

WASHINGTON, June 20 (Reuters) - Taiwanese electronics maker Asus ( opens new tab on Friday defeated rival Lenovo's ( opens new tab bid to block American imports of Asus' Zenbook laptops and other computers as part of a patent dispute between the two companies. The ruling, opens new tab by the U.S. International Trade Commission was a defeat for Hong Kong-based Lenovo in a patent fight with Asus that extends to California federal court and Europe's Unified Patent Court. Lenovo has accused Asus' computers of infringing patents related to wireless communications, diagonal touchpad scrolling and other technology. The commission's order on Friday, which upheld an ITC judge's preliminary decision from February, can be appealed to the Washington-based U.S. Court of Appeals for the Federal Circuit. Spokespeople for Lenovo and Asus did not immediately respond to requests for comment on the decision. Lenovo, the world's largest PC maker, sued Asus in San Jose, California, and at the ITC in 2023, alleging that technology in Asus' Zenbook Pro and Zenbook Flip 14 laptops infringed a variety of its patents. Lenovo asked the California court for an unspecified amount of monetary damages, including lost profits and royalties, and an order permanently blocking the alleged infringement. The California lawsuit was paused during the ITC proceedings.

Reuters

3 hours ago

• Reuters

Fed's Daly says a rate cut in the fall could be appropriate

June 20 (Reuters) - The fundamentals of the U.S. economy are moving to where an interest rate cut may be necessary, San Francisco Federal Reserve Bank President Mary Daly said on Friday, though she signaled a July rate cut would probably be too early. "Unless we saw a faltering in the labor market that was meaningful and we thought it would be persistent then I would say the fall looks more appropriate to me," Daly said in an interview on CNBC. At the same time, she said, what is a current softening of the labor market could easily turn into a weakening, "and we can't allow for that to happen because we're waiting for inflation to pop up just around the corner."