AI pioneer announces non-profit to develop ‘honest' artificial intelligence
An artificial intelligence pioneer has launched a non-profit dedicated to developing an 'honest' AI that will spot rogue systems attempting to deceive humans.
Yoshua Bengio, a renowned computer scientist described as one of the 'godfathers' of AI, will be president of LawZero, an organisation committed to the safe design of the cutting-edge technology that has sparked a $1tn (£740bn) arms race.
Starting with funding of approximately $30m and more than a dozen researchers, Bengio is developing a system called Scientist AI that will act as a guardrail against AI agents – which carry out tasks without human intervention – showing deceptive or self-preserving behaviour, such as trying to avoid being turned off.
Describing the current suite of AI agents as 'actors' seeking to imitate humans and please users, he said the Scientist AI system would be more like a 'psychologist' that can understand and predict bad behaviour.
'We want to build AIs that will be honest and not deceptive,' Bengio said.
He added: 'It is theoretically possible to imagine machines that have no self, no goal for themselves, that are just pure knowledge machines – like a scientist who knows a lot of stuff.'
However, unlike current generative AI tools, Bengio's system will not give definitive answers and will instead give probabilities for whether an answer is correct.
'It has a sense of humility that it isn't sure about the answer,' he said.
Deployed alongside an AI agent, Bengio's model would flag potentially harmful behaviour by an autonomous system – having gauged the probability of its actions causing harm.
Scientist AI will 'predict the probability that an agent's actions will lead to harm' and, if that probability is above a certain threshold, that agent's proposed action will then be blocked.
LawZero's initial backers include AI safety body the Future of Life Institute, Jaan Tallinn, a founding engineer of Skype, and Schmidt Sciences, a research body founded by former Google chief executive Eric Schmidt.
Sign up to Business Today
Get set for the working day – we'll point you to all the business news and analysis you need every morning
after newsletter promotion
Bengio said the first step for LawZero would be demonstrating that the methodology behind the concept works – and then persuading companies or governments to support larger, more powerful versions. Open-source AI models, which are freely available to deploy and adapt, would be the starting point for training LawZero's systems, Bengio added.
'The point is to demonstrate the methodology so that then we can convince either donors or governments or AI labs to put the resources that are needed to train this at the same scale as the current frontier AIs. It is really important that the guardrail AI be at least as smart as the AI agent that it is trying to monitor and control,' he said.
Bengio, a professor at the University of Montreal, earned the 'godfather' moniker after sharing the 2018 Turing award – seen as the equivalent of a Nobel prize for computing – with Geoffrey Hinton, himself a subsequent Nobel winner, and Yann LeCun, the chief AI scientist at Mark Zuckerberg's Meta.
A leading voice on AI safety, he chaired the recent International AI Safety report, which warned that autonomous agents could cause 'severe' disruption if they become 'capable of completing longer sequences of tasks without human supervision'.
Bengio said he was concerned by Anthropic's recent admission that its latest system could attempt to blackmail engineers attempting to shut it down. He also pointed to research showing that AI models are capable of hiding their true capabilities and objectives. These examples showed the world is heading towards 'more and more dangerous territory' with AIs that are able to reason better, said Bengio.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Daily Mail
an hour ago
- Daily Mail
Major grocery chain to shutter more than 60 locations by end of 2026
Kroger has announced plans to close more than 60 underperforming stores across the US by the end of 2026, marking one of the largest closure rounds in the company's recent history. The news came during Kroger's first-quarter earnings report, released on June 20, which states that the closures are expected to result in a 'modest financial benefit.' 'In the first quarter, Kroger recognized an impairment charge of $100 million related to the planned closing of approximately 60 stores over the next 18 months. As a result of these store closures, Kroger expects a modest financial benefit,' the report states. Kroger also emphasized its intention to reinvest savings from the closures into improving the customer experience. 'Kroger is committed to reinvesting these savings back into the customer experience, and as a result, this will not impact full-year guidance,' the report reads. Despite the scale of the closures, the company said no layoffs are expected. Employees at affected locations will be offered positions at nearby stores or in other areas of the business. 'Kroger will offer roles in other stores to all associates currently employed at affected stores,' the report states. The closings come after interim CEO Ron Sargent (pictured) took over after Rodney McMullen abruptly resigned on March 3 amid an internal ethics investigation Kroger, which operates nearly 2,800 stores nationwide under banners such as Ralphs, Fred Meyer, King Soopers, and Harris Teeter, has not yet released a list of affected locations. In the same report, Kroger disclosed that its Q1 2025 net income fell to $866 million, down from $962 million a year earlier. Total sales also declined slightly to $45.1 billion from $45.3 billion. Still, the company raised its full-year forecast for same-store sales (excluding fuel) to between 2.25 percent and 3.25 percent, citing strong demand for fresh foods, store brands and digital services. 'Our strong sales results and positive momentum give us confidence to raise our identical sales without fuel guidance, to a new range of 2.25 percent to 3.25 percent,' CFO David Kennerley commented in the report. 'While first quarter sales and profitability exceeded our expectations, the macroeconomic environment remains uncertain and as a result other elements of our guidance remain unchanged,' he added. Kroger also reaffirmed plans to spend between $3.6 billion and $3.8 billion this year on capital projects, including new store construction and renovations. The company aims to open around 30 new stores by the end of 2025, focusing on markets with stronger performance and growth potential. More details on the closures, including specific locations and timelines, are expected in the coming months. The closings come after interim CEO Ron Sargent took over after Rodney McMullen abruptly resigned on March 3 amid an internal ethics investigation. The grocer is currently undergoing a national search for a new CEO.
Daily Mail
3 hours ago
- Daily Mail
Soda fans claim they have discovered Coca-Cola's latest bizarre cost-cutting trick
Aggravated Coca-Cola fans are claiming the key to company cost-cutting is less carbonation. Nearly 100 Reddit users claimed they noticed an unacceptable difference in the soda's 'fizziness', which they say is a bizarre cost-cutting trick. 'I had a Coke for the first time in a few years, and yeah there was barely any carbonation in it,' a soda fan wrote in a Reddit post. 'I figured I had a bad bottle, but I could see them skimping out on something like that now.' Customers believe Pepsi is performing the same cost-cutting hack now that it's been knocked out of America's top three sodas. 'I have found the same issue with Pepsi. Mainly with the bottles, which sometimes almost seem completely flat, but the cans are not as fizzy either,' a commenter claimed. 'I complained to Pepsi Co a number of times, and tried drinks from various bottling locations. At this point I fully believe it is just a cost cutting measure.' Longtime enemies Coke and Pepsi have been competing for market share for decades, and frequently produce similar beverage flavors and marketing campaigns. Commenters claimed the affected soda was served at restaurant chains like McDonald's and Taco Bell. But Coca-Cola and Pepsi were not Reddit users' only targets in the fizzy diss. Other drinks that didn't meet fans' carbonation standards included Mountain Dew and Orange Celsius. 'The carbonation process is cheap, if they want to skimp, they would skimp on the syrup?,' a Reddit user commented. 'It amazes me the length these big companies will go to cut costs,' another person responded. 'You already produce one of the cheapest, easiest to make products in the not enough?.' Others targeted all corporate companies with their rage. 'At this point, if it is a corporation, their motto is F the current customer/employee to squeeze quarterly profits,' a commenter wrote. Coca-Cola and Pepsi have been bitter rivals in the soda wars for years A Reddit post flooded with comments from soda fans that are unsatisfied with their drinks This year's soda battle exploded when Pepsi copied Coca-Cola's famous 'Share a Coke' campaign with an advertisement dubbed 'Share a Pepsi.' Coke's 'Share a Coke' special launched in the US in 2014 when the company released bottles with popular names on them. Pepsi's latest campaign is all-new and includes food names on its bottles like 'burgers', 'pizza', and 'tacos.' The campaign began around the same time a Coca-Cola spokesperson confirmed fan-favorite Diet Cherry Coke would return to stores five years after discontinuation. The upcoming relaunch is strikingly similar to Dr. Pepper's Diet Dr. Pepper Cherry, a popular product offered by the soda brand since 2009. Both companies were the participants of highly publicized drink swaps. Costco opted to switch from Pepsi to Coca-Cola in food courts, while Subway ditched Coca-Cola for Pepsi.
Daily Mail
4 hours ago
- Daily Mail
'MAGA Mark' Zuckerberg leaves Meta staff horrified after Joe Rogan chat
Meta CEO Mark Zuckerberg 's new machismo and perceived alignment with President Trump has reportedly unsettled employees and execs inside the company. The billionaire tech mogul has been dubbed 'MAGA Mark' by staffers following his January appearance on The Joe Rogan Experience, where he criticized Corporate America as 'culturally neutered' and called for more 'masculine energy' in the workplace. Zuckerberg's remarks - made as an aspiring MMA fighter - sparked discomfort among employees at Meta, the parent company of Facebook and Instagram, according to the Financial Times. In the days following the interview, several executives raised concerns during a leadership meeting at Meta's California headquarters. 'He basically said, "If you don't like it, tough s**t,"' a source familiar with the conversation told the Financial Times. On the podcast, Zuckerberg, 41, also praised mixed martial arts as a form of male bonding and argued that male aggression can be constructive. 'There's this crazy thing about wrestling,' he told Rogan, a former MMA commentator. 'If you get into a fight with someone at work, you're probably going to get fired. But if you train in MMA, you can roll hard with someone and you're both better friends afterward.' 'In a lot of the corporate world, there's this assumption that aggression or intensity is inherently negative,' he added. 'But it's not. I actually think it's useful - you just need to know how to channel that energy.' Zuckerberg's evolution from a traditional Silicon Valley liberal to someone increasingly aligned with Donald Trump, 79, has become a hallmark of his leadership at Meta. Once known as a low-profile, hoodie-clad Democrat, Zuckerberg has reshaped his public persona - appearing shirtless in MMA training videos, sporting gold chains, and flaunting luxury watches. His appearance on Joe Rogan's podcast - one of several engagements with largely male, anti-woke audiences - fueled growing criticism that he's signaling a broader political shift to the right. His public praise for Trump and reductions in content moderation at Meta have further intensified concerns about the company's ideological direction, the Financial Times reported. But, insiders argue that Zuckerberg isn't changing so much as revealing a version of himself they've always known. 'When he was 19 years old, I think he had an idea in his head of what a CEO was supposed to be like and he was trying to be that, especially in public,' Meta's chief technology officer Andrew Bosworth, told the Financial Times. 'The public is seeing him more how we have, internally, since the beginning,' Bosworth added. Zuckerberg's evolving persona comes as he positions Meta aggressively in the high-stakes race for dominance in artificial intelligence. Last week, the company made headlines with its $14.3 billion acquisition of Scale AI, securing a 49 percent non-voting stake in the startup and access to its infrastructure and talent - including founder Alexandr Wang, who now leads Meta's new 'superintelligence' unit. However, his move has triggered backlash from rivals, with OpenAI and Google severing ties with Scale over conflict-of-interest concerns, the New York Post reported. With plans to spend $65 billion annually on AI by 2025, the technology company is 'betting big.' But, the ambitious approach comes with risks, including mounting costs, regulatory scrutiny, and challenges in retaining top engineering talent. As of Friday, Zuckerberg was the world's second-richest person, with a net worth of $245 billion, according to the Bloomberg Billionaires Index. Despite the heavy-hitting criticism, Zuckerberg isn't alone in his apparent shift toward a more MAGA- aligned stance. Amazon founder Jeff Bezos, once seen as a liberal-leaning titan of industry, has recently voiced criticisms of the Biden administration and echoed right-leaning talking points. Tesla and SpaceX CEO Elon Musk famously made a similar pivot earlier, aligning himself with conservative narratives on free speech, 'wokeness,' and government overreach - positions that initially found common ground with figures like Trump before their public falling out.
