How innocent people could be jailed because of sinister AI bot ChatGPT… and leave dangerous criminals walking free

ROBOCOP How innocent people could be jailed because of sinister AI bot ChatGPT… and leave dangerous criminals walking free
Click to share on X/Twitter (Opens in new window)
Click to share on Facebook (Opens in new window)
JURORS could secretly be using ChatGPT to decide crunch verdicts, top US lawyers fear.
Dean Strang and Jerry Buting, who starred in Netflix documentary Making a Murderer, warned it could see innocent people convicted - or let criminals off the hook.
4
Top lawyers have warned how ChatGPT could be being used to decide verdicts
Credit: Reuters
4
Jerry Buting and Dean Strang, who were Steven Avery's defence lawyers
The lawyers, who defended Steven Avery on the hit show, insisted it is vital jurors are stopped from accessing the AI tool during trials.
Strang said jurors could be tempted to use ChatGPT as a 'sounding board' if they are uncertain about a defendant.
But he stressed it could have "disastrous" consequences as jurors could get skewed answers that force a mistrial or bring them to the wrong decision.
Strang, who has worked in criminal defence for more than 30 years, told The Sun: 'Jurors should be banned from using ChatGPT.
More on AI
TRUTH TWISTING AI could jail innocent people with fake CCTV, Making a Murderer lawyer says
'I can't prove this and I'm not a computer engineer, but my sense is that AI, in part, is assessing what it thinks we want to hear and tailoring answers to its perception of what our human wishes and purposes are.
'That would be disastrous in a jury room, to the extent that AI decides the juror is inclined to a conviction.
'You're going to get a skewed answer. To the extent AI perceives the jurors are inclined to acquittal or if AI develops its own will, which I read is at least possible, kind of developing a consciousness.
'Either way, you're getting a skew and neither skew is good, and you're substituting out what you hope is human judgment, a human assessment of what's happening in the courtroom, credibility determinations.'
Asked if he fears jurors are already using the tool, or soon will, Strang answered: 'Yes.
'Some never would, and I fear that some would be tempted to or use it as a sounding board, use it as an advisor.
China's new cheap AI DeepSeek sparks ALARM as it outperforms West's models like ChatGPT amid race to superintelligence
'Even if the juror says I'm going to make the decision, but I'm getting advice from AI, that's going to be advice that's probably hard to ignore.'
Strang and Buting defended Avery in the 2015 documentary, which claimed Avery had been framed for the murder of Teresa Halbach.
Avery has been behind bars for the crime since 2007.
Before that, he spent 18 years in jail for a rape and attempted murder he was later found innocent of.
Strang and Buting continue to maintain his innocence, as does Avery himself.
Now, Buting fears even more alleged miscarriages of justice through the use of ChatGPT.
Buting, author of Illusion of Justice, told The Sun: 'I've seen people online take situations like the Steven Avery case or the Karen Reed case, a second trial going on right now because the jury was hung, try and use GPT by putting in the facts as they know them.
'Then they ask ChatGPT whether the person is guilty or innocent and they come up with an answer.
'It's bulls*** basically, because it depends on what you put in as the facts.
What are the arguments against AI?
Artificial intelligence is a highly contested issue, and it seems everyone has a stance on it. Here are some common arguments against it:
Loss of jobs - Some industry experts argue that AI will create new niches in the job market, and as some roles are eliminated, others will appear. However, many artists and writers insist the argument is ethical, as generative AI tools are being trained on their work and wouldn't function otherwise.
Ethics - When AI is trained on a dataset, much of the content is taken from the internet. This is almost always, if not exclusively, done without notifying the people whose work is being taken.
Privacy - Content from personal social media accounts may be fed to language models to train them. Concerns have cropped up as Meta unveils its AI assistants across platforms like Facebook and Instagram. There have been legal challenges to this: in 2016, legislation was created to protect personal data in the EU, and similar laws are in the works in the United States.
Misinformation - As AI tools pull information from the internet, they may take things out of context or suffer hallucinations that produce nonsensical answers. Tools like Copilot on Bing and Google's generative AI in search are always at risk of getting things wrong. Some critics argue this could have lethal effects - such as AI prescribing the wrong health information.
'This would be the problem with jurors doing it because jurors listen to the evidence.
"If they go back in there and they can't really resolve something themselves, well then that's probably reasonable doubt in most cases.
'But if they say, well, we can't resolve this, you think this and I think that and there's a dispute, let's put it into ChatGPT and see what it says, and then it comes up with an answer, then somebody may be swayed by that.
'AI, at least in its current iteration, has built in biases because of the algorithms.'
Buting previously told The Sun he fears AI could destroy the entire justice system by sending innocent people to jail with fake CCTV.
ChatGPT exploded onto the scene in 2022 and has since become an essential tool for individuals and businesses worldwide.
Buting said: 'We don't know at this point exactly how it's filtering, how it's learning.
'The idea is that it learns from more fact situations presented over and over, but what fact situations, what trials, for instance, is it looking at?
4
Steven Avery listens to testimony in the courtroom at the Calumet County Courthouse in 2007
Credit: AP:Associated Press
4
Jerry Buting argued to jurors that Steven Avery had been framed in Making a Murderer
Credit: NETFLIX
'Are there already ones where there has been a built-in bias? Because there is a lot of bias in America's legal system. Bias against minorities in particular.
'So are they kind of underrepresented in the algorithm, machine learning that is happening with AI? A lot of people wonder about that.
'I just know I've seen people use ChatGPT. I can use it and put in facts, and leave out facts that I want to, and it'll come up with an answer probably that I want.
'So I think there's a real problem.'
When The Sun asked ChatGPT if Avery was guilty, the response was: "Legally: Steven Avery is guilty, he was convicted and remains in prison.
What does the law say?
UNDER UK law, judges are allowed to use ChatGPT to assist them when making rulings.
AI assistance was given the green light by a landmark ruling in 2023.
Guidelines from the Judicial Office sent to thousands of judges across England and Wales said that the tech can be useful for summarising large volumes of text or carrying out administrative tasks.
However, it cautions that chatbots should relied upon for researching legal frameworks, because there is a risk it will fabricate cases or legal documents.
The guidelines also warn that generative AI technology could be used to create false evidence - such as deepfake pictures or videos.
The US is currently grappling with the integration of AI in its legal proceedings.
Spearheading progress is the Illinois Supreme Court, which issued guidance on the use of AI by judges and lawyers in December 2024.
The document encouraged the responsible and supervised use of AI, and suggested that the use of chatbots in drafting pleadings need not be declared.
Its tone is generally pro-AI, and emphasises that existing legal and ethical guidance can be applied.
In early May 2025, a federal judicial panel advanced a proposal to seek the public's feedback on a draft rule designed to ensure AI-produced evidence meets the same standards as human evidence.
'Public opinion and expert debate: Divided. Many believe he may have been wrongfully convicted again, especially given the suspicious handling of evidence.
'No definitive proof of innocence or of a frame-up has yet convinced the courts.'
It comes as fears continue to be raised about its threat to jobs, and the dangers of the software outsmarting humans.
Many experts have also warned of the security dangers of advanced AI – and how cyber-crooks could abuse them to scam innocent victims.
The Sun has approached ChatGPT for a response.

Try Our AI Features

Explore what Daily8 AI can do for you:

Learn with AIFact CheckingText to SpeechAI Summary

Related Articles

Telegraph

3 hours ago

• Telegraph

Johnny Depp: My friends betrayed me

Johnny Depp, the Hollywood actor, has claimed he was betrayed by his friends after being accused of abuse by his ex-wife Amber Heard. The strongly denied claims were first levelled against Depp, 62, by Heard during divorce proceedings in 2016. The actor's failed marriage to the 39-year-old actress made international headlines when details of alleged violence between the pair were aired in courts in the UK and US. Depp has now criticised the behaviour of several close friends at the time and also claimed he had been a 'crash test dummy for the #MeToo movement'. 'I'll tell you what hurts. There are people, and I'm thinking of three, who did me dirty. Those people were at my kids' parties, throwing them in the air,' he told The Sunday Times. 'And, look, I understand people who could not stand up [for me], because the most frightening thing to them was making the right choice.' One individual who spoke out against Depp despite their long working relationship was Tracey Jacobs, his agent of 30 years, who was sacked in 2016. She claimed during Depp's legal battles that studios were 'reluctant' to hire him because of his lateness. Depp said of Jacobs: 'My loyalty is the last thing anybody could question. I was with one agent for 30 years, but she spoke in court about how difficult I was.' His image came under global scrutiny when he brought a libel case against The Sun newspaper after he was described as a 'wife-beater' in a column. Numerous alleged details of the couple's marriage were made public during the case, including claims of the actor having a finger severed, being struck by Heard, passing out drunk and finding her faeces in their bed. Depp said he felt compelled to risk revealing details of his personal life, adding: 'Look, it had gone far enough. I knew I'd have to semi-eviscerate myself. Everyone was saying 'It'll go away'. But I can't trust that.' While a judge ruled against Depp in his High Court case against The Sun, the star won damages for defamation from Heard in June 2022 following a legal battle in the US. But the allegations of abuse levelled against Depp by Heard continued to dog the film star, whose presence at the Cannes film festival in 2023 was opposed by several feminist groups in France. Following a period away from major Hollywood productions, Depp has this year been working on his comeback film Day Drinker. In the thriller, Depp will star as a mysterious guest on a private yacht who finds himself entangled with a criminal, played by Penelope Cruz.

Reuters

3 hours ago

• Reuters

Blast rocks church in Syria's Damascus, witnesses say

June 22 (Reuters) - A blast rocked the Mar Elias Church in the Dweila neighbourhood of Syria's capital Damascus on Sunday, according to witnesses. One told Reuters a suicide bomber detonated himself inside the church. A spokesperson for Damascus security forces did not immediately respond to a request for comment.

Daily Mirror

6 hours ago

• Daily Mirror

Andy Carroll and Lou Teasdale 'disappointed' after police called over row

Footballer, Andy Carroll, and his girlfriend, Lou Teasdale, admitted that the police were called after the couple had a 'heated discussion', which they say was 'blown out of proportion' Andy Carroll and his hair stylist girlfriend, Lou Teasdale, have admitted they were spoken to by police following a row between the couple on the Greek island of Mykonos. The pair, who have been dating since last year following the footballer's split with the mum of his three kids, Billi Mucklow, revealed they'd had a "heated discussion" while on the party island, but that things had been "blown out of proportion". Andy, 36, was reportedly questioned about a bust-up he'd had with Lou, 42, at a packed beachside restaurant and then at their hotel. One worker at the Nikolus Tavern said of the first argument: 'We recognised him as the footballer Andy Carroll immediately. He seemed very drunk and furious with his partner. He was using very bad words. It was improper behaviour. The woman looked very upset.' ‌ ‌ The Sun reports that police arrived and took the former West Ham ace, who was "very calm" to one side for a chat. He was later allowed to return to Lou, who is a well-known celebrity hairstylist. However, hours later police were reportedly called again by staff after reports of damage to the couple's room at a £500-a-night boutique hotel. Officers are said to have escorted Andy to a local station for questioning but no arrests were made. Another source claimed Lou did not stay with her boyfriend that night. They said: "After the restaurant episode, there was another incident at the hotel. This time, the footballer went to the police station. We know the woman stayed somewhere else that night.' Meanwhile, a British holidaymaker who reportedly spotted the pair while out for a stroll accused Andy of being "very drunk" adding that he shouted at Lou: "I'm done with us!" ‌ Responding to the reports, Andy and Lou admitted that the police were called following their "heated discussion", however they insisted things had been "blown out of proportion", issuing a joint statement, which read: "Whilst having a private dinner in a restaurant on a quiet holiday in Mykonos, we had a heated discussion of the sort that most couples have had on occasion. It quickly became apparent to the police that there was no reason for them to be there. 'We went outside the restaurant with them together as they insisted they wanted to 'look after' us. 'As far as we are concerned, the situation has been blown out of all proportion by an interested member of the public. No one was arrested, and no one was charged with anything. "We are very happy, in love and looking forward to our future together, and we are disappointed that a private disagreement has become a public matter.'