Children's Commissioner Calls for Ban on AI ‘Nudification' Apps

The children's commissioner has called on the government to ban tools using deepfake technology to create naked images of children.
Bespoke nudification apps enable users to generate sexually explicit images of real people, bringing 'alarming risks' to children's safety online, Dame Rachel de Souza has warned.
In a
The report highlights how girls and young women are disproportionately targeted by such technology.
One 16-year-old girl
While it is illegal to possess AI-generated sexual images of children, current laws do not prohibit the AI models that produce them.
Related Stories
4/24/2025
3/3/2025
De Souza has called on ministers to outlaw nudification apps entirely and to tighten regulations to hold technology providers accountable.
'The online world is revolutionary and quickly evolving, but there is no positive reason for these particular apps to exist. They have no place in our society.
'Tools using deepfake technology to create naked images of children should not be legal and I'm calling on the government to take decisive action to ban them, instead of allowing them to go unchecked with extreme real-world consequences,' she said.
Existing Legislation
In early 2025, the government announced plans to extend protections against AI-generated sexual content involving adults through the Data Use and Access Bill, alongside measures in the Crime and Policing Bill.
Both pieces of legislation remain under parliamentary review.
However, these laws focus on criminalising individuals who create or share such content and stop short of banning the AI technology itself.
Under the Online Safety Act 2023, online platforms must prevent UK users from accessing illegal material, including child sexual abuse content. The Act also requires tech companies to protect children from harmful material, such as pornography.
Further protections are due in July 2025 when
The children's commissioner's report warned that without decisive legislative action, children will remain at risk from emerging AI threats.
Growing Risks of Deepfake Technology
An estimated 99 percent of sexually explicit deepfakes circulating online feature women and girls. These AI tools are often trained on vast datasets of solely female bodies.
While high-profile women, like Emma Watson, Scarlett Johansson, and Millie Bobby Brown are frequent targets, the report warned of risks to ordinary women and schoolchildren.
Children themselves are being exposed to this harmful material at alarming rates.
A 2024 survey by
Another study by Girlguiding found that more than a quarter of 13-18-year-olds had encountered sexually explicit deepfakes of celebrities, friends, teachers—or even themselves.
The report also found that children with vulnerabilities are disproportionately at risk, with 25 percent reporting exposure to sexually explicit deepfakes—more than twice the rate of their non-vulnerable peers.
The document cited cases where victims have experienced PTSD, suicidal thoughts, and in tragic instances, death—such as
The Commissioner's Office found nudification apps openly advertised on social media platforms like Instagram, Telegram, and X (formerly Twitter), with some accounts holding X Premium status—traditionally associated with verified users.
Searches on major app stores also returned nudification tools, despite previous crackdowns, while Google and Bing searches for terms like 'deep nude' or 'undress app' frequently led to explicit content within a few clicks.
The rise of what Ofcom has termed the 'deepfake economy'—a network of websites, app developers, and individual users profiting from non-consensual sexual imagery—has only worsened the threat. Open-source AI models, which can be freely adapted, are being exploited to create customised nudification services, with little oversight or accountability.
De Souza said children who took part in focus groups for the report had voiced fears about the misuse of nudification app technology.
'They fear that anyone—a stranger, a classmate, or even a friend—could use a smartphone as a way of manipulating them by creating a naked image using these bespoke apps,' she said.

Try Our AI Features

Explore what Daily8 AI can do for you:

Learn with AIFact CheckingText to SpeechAI Summary

Related Articles

E&E News

8 hours ago

• E&E News

Rule-busting language may return to GOP megabill

After weeks of back-and-forth over a Republican proposal to dramatically expand Congress' veto power over federal regulations, the provision was left out of the Senate's initial version of the GOP's party-line megabill. But advocates fighting the deregulatory provision, based on the 'Regulations from the Executive in Need of Scrutiny Act (REINS) Act,' say they are not yet out of the woods. The language could still return via amendment as final negotiations continue ahead of a floor vote. A senior Republican Senate staffer, granted anonymity to speak candidly, said talks about the deregulatory provisions remain ongoing and that, should a version of the 'REINS Act' be deemed sufficiently budgetary to be eligible, it will be added into the megabill. Advertisement The GOP is looking to pass its tax, energy and border security bill through budget reconciliation. It's a process that allows certain fiscal legislation to bypass the Senate filibuster, but it must follow certain rules.

CNBC

14 hours ago

• CNBC

Circle shares extend their rally after Senate passes landmark stablecoin bill

Shares of Circle continued to climb on Friday as investors cheered the Senate approval of its proposed stablecoin legislation, the GENIUS Act. The stock was up 14% in premarket trading as excitement continued to build. The bill passed the Senate on Tuesday, and shares rose 33% on Wednesday. The market was closed Thursday for the Juneteenth holiday. Circle is on pace to end the week higher by almost 50%. It has rocketed more than 500% since its initial public offering on June 5. Stablecoins are cryptocurrencies whose values are pegged to that of another asset, usually the U.S. dollar. Traditionally used as bridge currencies for crypto traders, stablecoins today are benefiting from increased interest by banks and payment firms as the Trump administration rolls back Biden-era crypto policies. Stablecoins have attracted a groundswell of investor interest in anticipation of regulatory clarity from Congress, as they have the potential to make payments faster and cheaper. Amazon and Walmart are reportedly exploring the possibility of using or issuing their own stablecoins. Uber, Apple and Airbnb are among other big companies reported to be exploring stablecoins in recent weeks. The GENIUS (short for Guiding and Establishing National Innovation for U.S. Stablecoins) Act seeks to establish clear regulatory guidelines for the use of stablecoins regarding issuance, reserves and compliance. The bill now heads to the house, which has its own stablecoin legislation in the works, called the STABLE Act.

Cosmopolitan

a day ago

• Cosmopolitan

A choking ban and ID checks: all the ways porn is changing in 2025 — and what needs to come next

It's a transformative time for pornography. Long gone are the days where explicit sexual content could only be found in the adult section of video stores. Now, porn is freely available at the click of a button — and it's not just limited to dedicated adult sites. Unsuspecting users are exposed to porn on social media platforms like X and Reddit, which are rife with X-rated content (but not so harshly regulated as porn sites). This easy accessibility means that the public are increasingly exposed to it at a younger age. Recent research shows that the average age in the UK that people first see explicit material online is 13. Concerningly, much of this material seems to depict violence, with a 2023 report finding that 79% of 18 to 21-year-olds who'd seen porn online had encountered videos portraying degrading acts, physical aggression, or sexual coercion. The effects of this have been much discussed in pop culture. In 2021, Billie Eilish famously revealed that she started having nightmares after being exposed to 'abusive' pornography from the age of 11. Meanwhile, the Netflix series Adolescence explored the consequences of young people having access to violent content online without the proper critical thinking skills to challenge certain acts, ideas, and attitudes. Beyond porn, young people are also increasingly exposed to non-consensual intimate content via terrifying 'nudify' apps and deepfake technology, which make it possible for any unsuspecting person (usually a woman) to be virtually stripped naked or superimposed into explicit videos and photos. All of this has led to a growing backlash against sexual content online — and a call for legislators to crack down on it. We can already see this happening in other counties. In Sweden, for example, live cam shows and custom-made pornographic content were banned last month. In the US, in light of age verification laws being introduced in certain US states (which critics say is a violation of privacy and a data risk), Pornhub is blocked in 17 states. Then, in May, a new bill was introduced aiming to criminalise pornography at a federal level, meaning, if passed, it could be banned across the whole of the US. And now the UK is following suit. It was already planned that from July, websites hosting pornographic content will have to run ID checks on users, but yesterday [18th June] it was confirmed that pornography depicting acts of strangulation will be made illegal in the UK, as per a government announcement. The amendment will be made to the Crime and Policing Bill — though there isn't yet a date for its implementation. The government's decision was made following an Independent Porn Review which found that media sources, including pornography, have 'effectively established choking as a 'sexual norm', and a belief that choking a partner during sex is 'safe''. This is, obviously, worrying, and it's encouraging that the government is trying to tackle the rise of non-consensual choking, which mostly affects women and girls. It's a move that's been welcomed by safety campaigners and women's charities alike, and generally viewed as a step in the right direction. But will these measures really work? Amid the dire state of sex education in the UK, is this the right focus? And, as right wing conservatism grows, is a crackdown on sexual expression actually moving us forward? Data shows sexual strangulation has been on the rise in recent years, and it seems explicit online depictions of it have contributed to this, particularly among young people. A recent survey by the Institute for Addressing Strangulation (IFAS) found that it's most common among those aged 16 to 34, with 35% of respondents saying they've been choked during sex, while 17% said it had happened without their consent. 'I've experienced choking from casual sex partners before, and not always with my consent,' 35-year-old Bryony* tells Cosmopolitan UK. 'I was having sex once with a hook-up from Hinge and he suddenly grabbed my throat. I was so shocked by it that I froze — I would have struggled to talk with his tight grip anyway. He realised by my facial expression that I was taken aback and soon let go. It was a frightening experience.' Erotic asphyxiation is a genuine sexual kink/fetish, but seems to be increasingly misunderstood and mispracticed by those who seemingly don't know what they're doing. It has also sinisterly been used as a defence in many murder trials, including the harrowing case of Grace Milane, whose killer claimed she had died as a result of choking during consensual sex. Following this trial, the 'rough sex gone wrong' defence was banned in the UK — a key step in acknowledging that women cannot consent to their own harm or murder. As mentioned, women's groups have voiced their support for the criminalisation of choking porn, with Andrea Simon, the director of the End Violence Against Women Coalition, saying in a press release: 'Women cannot consent to the long-term harm [strangulation] can cause, including impaired cognitive functioning and memory. Its widespread portrayal in porn is fuelling dangerous behaviours, particularly among young people.' The availability of this kind of violent porn, and porn more broadly, is why the government is introducing its age verification laws next month, as part of the Online Safety Bill, which will force any websites or platforms (presumably including social media sites) that allow pornography to introduce effective age checks. This may include users providing their driver's license or passport, credit card details, or even agreeing to facial age estimation technology. It's unclear how exactly this will work in practice, and whether sites like Pornhub will simply block access in the UK, as they have done in the US, in light of the potential privacy risks. In a statement, digital rights campaigners Open Rights Group warned: 'The roll-out of age verification is likely to create new cybersecurity risks. This could take the form of more scam porn sites that will trick users into handing over personal data to 'verify their age'.' Although the ban is well-intentioned, it's easy to announce something but much harder to implement it in practice. 'In one regard, yes, it's a good idea to [stop people seeing] anything that is clearly harmful to women. But simply banning it isn't going to solve the problem,' says Marcus Johnstone, a criminal defence solicitor at PCD Solicitors. For one, Johnstone continues, 'you can ban lawful porn sites depicting non-fatal strangulation, but then what happens? It goes underground'. There's also the issue of who the liability falls to. 'Are they criminalising the makers, watchers, possessors of the image, [or the platforms that host them]? None of that is very clear,' adds Sean Caulfield, a partner in the crime team at Hodge Jones & Allen. There's no denying that something needs to be done about rising misogyny and violence against women and girls, including non-consensual choking. But what young people really need is comprehensive sex education, including porn literacy. Banning choking porn doesn't seek to tackle the true crux of the problem. Instead, we should be ensuring that all content young people can access on the internet is safe, and that the porn they are being exposed to is appropriately regulated. 'It's clear we need far more effective legislation to ensure online safety,' says Susie McDonald, the CEO of Tender, a charity that educates on healthy relationships. 'But equally critical is the need for all children and young people to access high quality relationships education so they can understand the key tenets of healthy relationships like consent and respect — and recognise the early warning signs of abuse. 'Right now, too many simply don't have access to this vital education,' she continues. 'RSHE needs to play a key role in keeping our young people safe, online and in the real world. We have a responsibility to protect all children as early as possible.' Implementing parameters of safety around online porn, especially for impressionable young people, is key — but so is ensuring they have a full understanding of things like consent, to be able to make appropriate decisions in their own personal lives. 'Adults need to be trusted to make adult choices, but that only works if they're equipped with context and critical thinking skills,' agrees Madelaine Thomas, senior policy advisor at the Digital Intimacy Coalition. 'Porn is entertainment, not education. It is fiction and should be enjoyed as such, not as an instructional guide. Porn shouldn't be used to educate unless it explicitly labels itself as such. The key is in educating that porn is fiction and filling the gap in education to teach so that they don't look to fiction as fact.' For some, strangulation kinks are genuine, and there will be people in consenting sexual relationships who choose to engage in such acts. There is already a law banning porn depicting graphic strangulation, and incoming age verification laws that should, in theory, prevent under 18s from viewing pornography of any kind. Depictions of strangulation shouldn't be freely accessible online, but the problem goes far beyond the porn young people are watching. We urgently need comprehensive sex education, media and porn literacy, and to encourage open, judgment-free conversations about sex, relationships, and consent. There also needs to be more funding for services that work to prevent violence against women and girls, a justice system that actually achieves justice for victims of sexual violence, and education that seeks to address the rise in misogyny among young people — and the real world effects that it has.