Law & society: A proposed curb on deepfake AI is a necessary step

Act MP Laura McClure showing an AI generated deepfake nude photo of herself in Parliament. Photo / Supplied
The rise of deepfake technology has sparked debate in New Zealand over whether existing legislation, particularly the Harmful Digital Communications Act 2015 (HDCA), is sufficient to address the harms caused by AI-generated content.
Act MP Laura McClure has introduced the Deepfake Digital Harm and Exploitation Bill, a private member's

Try Our AI Features

Explore what Daily8 AI can do for you:

Learn with AIFact CheckingText to SpeechAI Summary

Related Articles

The Spinoff

5 hours ago

• The Spinoff

Pornographic deepfakes are ruining lives. What are we doing about it?

They're made and spread quickly, cause intense harm and mostly target younger women and girls, but creating and sharing pornographic deepfakes is, in most cases, totally legal. Act MP Laura McClure's member's bill wants to change that. Content warning: This piece discusses suicide and sexual exploitation. The pictures were surprisingly easy to make. All she had to do was upload a photo of herself onto a website found through a quick search, and let it spew out AI-generated images of her naked in the bedroom, the bathroom, the kitchen – there was even a tool to make her appear more childlike. Her body may have been imagined, but for all intents and purposes, it was imagined to be her. It was a first for parliament when Act MP Laura McClure presented a doctored image of herself nude to the House in mid-May, but according to Netsafe, these pornographic deepfakes are now popping up and ruining lives almost daily. They're quick to make, cause incredible emotional damage and they mostly target younger women and girls, but they're not illegal, and there's no way of knowing exactly how many New Zealanders are being harmed by them. A member's bill drafted by McClure would criminalise the creation of these images by adding amendments to the Harmful Digital Communications Act 2015 and Crimes Act 1961 to expand the definition of 'intimate visual recordings' to include those that have been synthesised. McClure told The Spinoff the bill was born from numerous discussions with parents, school teachers and advocates whose daughters and students had been impacted by pornographic deepfakes. The stories McClure heard were deeply upsetting – in one instance, a 13-year-old girl had attempted suicide on school grounds after being deepfaked in this way. At a school in North Canterbury, 15 girls had explicit deepfaked images of themselves shared on social media. In one Auckland school, a group of 50 girls in the year 10 cohort were targets of this. One teen girl of Muslim faith was deepfaked naked as a 'joke', McClure said. The experience was not only 'deeply offensive' for the girl, but it had a significant impact on her relationship with her family. 'It's something that schools are really struggling to tackle, because there is a grey area in our legislation,' McClure said. 'There is no real way that victims of this can get any justice and real support, because the support isn't there when it's not a crime.' With near-daily calls being made to Netsafe about these images, chief online safety officer Sean Lyons told The Spinoff the fear they instil in targets is 'huge', and can be 'emotionally and psychologically damaging in the very worst ways for many people'. The online safety organisation works with targets and perpetrators to remove this online content and impose civil sanctions (typically a fine) where possible, and while larger platforms such as Pornhub are typically responsive in these cases, others exist solely for the purpose of sharing these images. 'We know the amount of harm that these things cause is directly related to just how long it's up there – just how long people perceive that people can see this really does amplify the harm that individuals feel,' Lyons said. The homespun logic that if you don't take a risqué image of yourself, then you won't be a victim of being seen in a sexually compromising position without your consent is no longer true, Lyons said – now, anyone can be a victim of image-based abuse. In some ways, having a pornographic deepfake of yourself made and posted online can be far more damaging than if the image was real, lawyer Arran Hunt told The Spinoff. 'You have no choice as to that image being created in the first place,' he said. 'It's completely out of your hands.' Hunt has been long advocating for our laws to catch up with this technology because as it stands, no one has been successful in taking a deepfake case down a criminal legal pathway. It all comes down to the intention, Hunt said, and the creation of pornographic deepfakes is typically driven by desire for 'financial gain, a laugh, peer pressure, attention – to cause harm is often not actually the reason they're doing it'. When the Harmful Digital Communications Act 2015 was amended in 2022 to include unauthorised posting of an intimate visual recording, Hunt was one of many submitters in the select committee process who suggested the definition of this material should include synthesised images. The suggestion didn't make it past the submissions phase, and Hunt worries it will take the death of a 'blonde white female' for our laws to catch up. Hunt said the onus needs to be on the creator of the image, rather than the app or platform that generates it. 'If Little Johnny is creating deepfakes of somebody else and it's causing them harm, then Little Johnny should be facing the court,' Hunt said. 'Not just that we'll have a meeting with Little Johnny's parents and hopefully he stops doing it because he's a menace.' McClure's bill is a member's bill, so it's sitting in the biscuit tin, waiting for a chance to be plucked and introduced to parliament. After telling the Herald in May that he was not considering adopting it as a government bill, justice minister Paul Goldsmith will be meeting with McClure in July to discuss the bill. It's been 'frustrating' waiting for change, McClure said, but a meeting with the minister is a 'positive step forward'. 'What I do think the government needs to consider is, do we want to put these preventions in place now while the issue is just emerging and starting to grow, or are we going to be reactive when a young girl takes her life?'

NZ Herald

5 hours ago

• NZ Herald

Law & society: A proposed curb on deepfake AI is a necessary step

Act MP Laura McClure showing an AI generated deepfake nude photo of herself in Parliament. Photo / Supplied The rise of deepfake technology has sparked debate in New Zealand over whether existing legislation, particularly the Harmful Digital Communications Act 2015 (HDCA), is sufficient to address the harms caused by AI-generated content. Act MP Laura McClure has introduced the Deepfake Digital Harm and Exploitation Bill, a private member's

RNZ News

16 hours ago

• RNZ News

The House: Tactics from the 'Scrutiny Week' bear pit

Photo: VNP/Louis Collins This week, Parliament hosted a twice-yearly event called 'Scrutiny Week'. It was a sitting week and MPs were expected to be in Wellington, but the House didn't sit, no legislation was debated and there were no question times. Instead, the ministers were all expected to spend time fronting hearings in the 12 subject select committees defending their budget plans - hence 'scrutiny'. On the Sunday edition of The House (above) you can hear an interview with Lawrence Xu-Nan about Scrutiny Week and the intense preparation necessary. You can also listen to a quick description of a few of the more political tactics observed in hearings. Politics muddies everything in Parliament, including Parliament's role in providing governance over governments. In Scrutiny Week, some politics is inevitable in both MPs' questions and ministers' answers. Our focus on the tactics is more about the answers than the questions, because those answering tend to employ a wider range of techniques. Either the ministers have more tactical options available or they are more creative in finding them. No matter who is in government, some ministers genuinely engage in the spirit of the event, freely answering questions and providing information. Others tend to be grudging with details. Some face aggressive political questions evincing fiercely political answers and a few appear to just really enjoy the stoush. Photo: VNP/Louis Collins Listen above for examples of political questions and answers tactics, including rejection of questions, answering alternative questions, redefining the terms, insult and humour as a defence, and various ways to eat up time. Oddly, sometimes ministers get so involved in the tussle that they ignore options to their own benefit. Typically, sitting beside a minister under scrutiny are senior ministerial officials - whose answers are less politically suspect. Sometimes, if an official can get a word in, the detail given is positive and the minister had no reason to be obfuscating - other than for the fun of the stoush. The audio above might give the appearance that Scrutiny Week is an endless and frustrating bear pit, and it can be, but we also saw hearings where ministers from all the governing parties gave good answers and had constructive interchanges with the committees, sometimes even in contentious areas. That is especially true in hearings where officials from ministries or agencies are providing information, but examples of good in-depth discussions are, almost by definition, far too lengthy to include in a short programme. Good politics is seldom quick politics. Photo: VNP/Phil Smith *RNZ's The House, with insights into Parliament, legislation and issues, is made with funding from Parliament's Office of the Clerk. Enjoy our articles or podcast at RNZ.