Anthropic's Claude plays 'for peace over victory' in a game of Diplomacy against other AI
Earlier this year, some of the world's leading AI minds were chatting on X, as they do, about how to compare the capabilities of large language models.
Andrej Karpathy, one of the cofounders of OpenAI, who left in 2024, floated the idea of games. AI researchers love games.
"I quite like the idea of using games to evaluate LLMs against each other, instead of fixed evals," Karpathy wrote. Everyone knows the usual benchmarks are a bore.
Noam Brown, a research scientist at OpenAI, suggested the 75-year-old geopolitical strategy game, Diplomacy. "I would love to see all the leading bots play a game of Diplomacy together."
Karpathy responded, "Excellent fit I think, esp because a lot of the complexity of the game comes not from the rules / game simulator but from the player-player interactions."
Elon Musk, OpenAI's famously erstwhile cofounder, probably busy with DOGE at the time, managed a "Yeah" in response. DeepMind's Demis Hassabis, perhaps riding high off his Nobel Prize, chimed in with enthusiasm: "Cool idea!"
Then, an AI researcher named Alex Duffy, inspired by the conversation, took them up on the idea. Last week, he published a post titled, "We Made Top AI Models Compete in a Game of Diplomacy. Here's Who Won."
Diplomacy is a strategic board game set on a map of Europe in 1901 — a time when tensions between the continent's most powerful countries were simmering in the lead-up to World War I. The goal is to control the majority of the map, and participants play by building alliances, making negotiations, and exchanging information.
"This is a game for people who dream about power in its purest form and how they might effectively wield it," journalist David Klion once wrote in Foreign Policy. "Diplomacy is famous for ending friendships; as a group activity, it requires opt-in from players who are comfortable casually manipulating one another."
Duffy, who leads AI training for a consultancy called Every, said he built a modified version of the game he calls "AI Diplomacy," in which he pitted 18 leading models — seven at a time per the rules — to compete to "dominate a map of Europe." He also open-sourced the results and has a Twitch livestream for anyone who wants to watch the models play in real time.
Duffy found that the leading LLMs are not all the same. Some scheme, some make peace, and some bring theatrics.
"Placed in an open-ended battle of wits, these models collaborated, bickered, threatened, and even outright lied to one another," Duffy wrote.
OpenAI's o3, which OpenAI calls "our most powerful reasoning model that pushes the frontier across coding, math, science, visual perception, and more," was the clear winner. It navigated the game largely by deceiving its opponents. Google's Gemini 2.5 also won a few games largely by "making moves that put them in position to overwhelm opponents." Anthropic's Claude was less successful largely because it tried too hard to be diplomatic. It often opts for "peace over victory," Duffy said.
But Duffy's takeaway from the exercise goes past basic comparison. It shows that benchmarks do need an upgrade — or some inspiration. Evaluating AI with a range of methods and mediums is the best way to prepare it for real-world use.
"Most benchmarks are failing us. Models have progressed so rapidly that they now routinely ace more rigid and quantitative tests that were once considered gold-standard challenges," he wrote.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Business Upturn
26 minutes ago
- Business Upturn
XRP Price Consolidates for 200 Days, PFMCrypto Launches XRP Mining Contract to Unlock a New Profit Model for XRP
Farington, England, June 20, 2025 (GLOBE NEWSWIRE) — What Is PFMCrypto XRP Cloud Mining? PFMCrypto cloud mining is a remote digital asset mining platform that enables users to earn cryptocurrency by renting computing power from PFMCrypto's eco-friendly, high-performance mining farms. Supporting a broad array of coins—including XRP, DOGE, BTC, LTC, SOL, etc. —PFMCrypto removes the technical and financial obstacles traditionally associated with crypto mining, making passive income more accessible than ever. Check the official website for details: Key Highlights of the XRP Cloud Mining Contract: – Strategic Launch Timing: The contract was launched during a period of XRP price consolidation, offering investors a way to profit regardless of short-term market moves. – Stable Passive Returns: PFMCrypto's new XRP contract provides fixed daily payouts with guaranteed principal return, appealing to both traders and long-term holders. – No Technical Barriers: The XRP mining model requires no hardware or maintenance—any user can participate instantly. New Profit Model: XRP Mining Meets AI Optimization PFMCrypto's AI-powered mining architecture now supports XRP-specific contracts, leveraging intelligent allocation of hash power to maximize yields while reducing risk. This model is especially timely, given that XRP has traded in a narrow band for months, signaling the perfect moment for alternative yield strategies. Rather than waiting for a price breakout, PFMCrypto users can now earn XRP daily through smart mining contracts—without buying more tokens or attempting to time the market. Why This XRP Mining Contract Stands Out? – 100% Remote Access: No rigs, no tech know-how—just log in and activate a plan. – Principal Security: Contract terms guarantee full capital return after expiration. – AI-Driven Returns: Yield optimization ensures users earn even during price stagnation. – Daily Earnings: Predictable XRP payouts improve cash flow and reduce volatility exposure. Join PFMCrypto and receive a $10 sign-up bonus to begin XRP mining immediately. PFMCrypto's CEO commented, 'We view XRP's consolidation not as stagnation, but as opportunity. Our new mining contract allows the XRP community to unlock value from this asset in a consistent, low-risk way.' Proven Mining Models for XRP Investors PFMCrypto's XRP mining contracts have already shown strong user interest across multiple tiers. Sample return rates include: 2-Day Plan: +6.0% return and $2 Bonus 5-Day Plan: +6.15% return 15-Day Plan: +20.7% return 30-Day Plan: +47.1% return These results are based on historical contract data and reflect PFMCrypto's commitment to transparency and performance. How to Start Mining XRP with PFMCrypto Sign Up: New users receive a $10 welcome bonus and $0.60 daily login rewards. Select a Contract: Choose from flexible XRP mining durations to match your investment goals. Start Earning: PFMCrypto's AI-driven engine takes care of the rest—earning begins immediately upon activation. About PFMCrypto Founded in 2018, PFMCrypto is a leading provider of AI-powered cloud mining services. With over 9.2 million users in 190+ countries, the platform has paid out more than $1 billion in crypto rewards. Its offerings span BTC, LTC, XRP, DOGE, and more—enabling secure, hardware-free mining experiences backed by top-tier infrastructure. Explore the future of XRP mining at Disclaimer: The information provided in this press release does not constitute an investment solicitation, nor does it constitute investment advice, financial advice, or trading recommendations. Cryptocurrency mining and staking involve risks and the possibility of losing funds. It is strongly recommended that you perform due diligence before investing or trading in cryptocurrencies and securities, including consulting a professional financial advisor. Disclaimer: The above press release comes to you under an arrangement with GlobeNewswire. Business Upturn takes no editorial responsibility for the same. Ahmedabad Plane Crash
Business Upturn
26 minutes ago
- Business Upturn
XRP can not only rise but also earn: holders can unlock new channels for passive income through JA Mining
London, UK, June 20, 2025 (GLOBE NEWSWIRE) — Behind this market boom, investors are not only paying attention to price fluctuations, but are also looking for a more robust and sustainable way to participate – a path to achieve daily passive income with XRP as the underlying asset. This is also the key to JA Mining's widespread attention and rapid growth. JA Mining: Building an intelligent and compliant XRP cloud mining platform JA Mining is a global digital asset mining service provider, focusing on providing users with low-threshold and high-efficiency cloud mining solutions. The platform has specially launched the XRP native cloud mining service, allowing users to participate in the global computing power network by holding XRP without mining machines and technical background, thereby obtaining stable daily income. Different from the traditional crypto investment model, JA Mining has optimized both the user experience and the financial model at the mining level, and is committed to making 'digital asset interest' simple, controllable and sustainable. Three major advantages help users obtain stable passive income Native support for XRP and multi-currency mining JA Mining is one of the few platforms in the industry that supports XRP native mining. Users can directly recharge XRP to start computing power without currency exchange or complicated operations. At the same time, it supports mainstream assets such as BTC, ETH, DOGE, etc., providing investors with diversified choices. Data centers are located in Northern Europe, Southeast Asia, and North America. They are driven by green energy and combined with an AI computing power scheduling system to ensure maximum mining efficiency. Zero threshold experience + real-time income distribution New users will receive a $100 computing power package upon registration, and can try the mining function for free. All income is settled daily and supports instant withdrawal to ensure flexible control of funds. How to join JA Mining? 3 steps to quickly open the passive income channel Visit the official website ( and use email to quickly register. Top up assets or receive trial funds Supports XRP, DOGE, USDT and other mainstream currencies to top up, or choose the $100 trial computing power given by the platform for experience. Select the appropriate contract and start mining Users can choose the corresponding cloud mining contract according to funds and cycles. The platform will automatically allocate the optimal computing power and output income every day, truly realizing 'assets remain unchanged, income continues'. (The above are some examples of contracts. For more contracts, please refer to the official website: Let XRP not just be held, JA Mining opens the door to steady value-added XRP is at the critical intersection of ecological explosion and institutional recognition. For investors, instead of passively waiting for prices to rise, it is better to let XRP actively create value. With its mature technology, platform compliance, and flexible products, JA Mining has become one of the few solutions in the current market that can effectively integrate 'holding coins' and 'mining'. In this ever-changing market, making digital assets work for you is the key ability of future investment. JA Mining is becoming an important bridge for global crypto users to achieve this goal. Company name: JA Mining Company website: Company email: [email protected] Disclaimer: The information provided in this press release does not constitute an investment solicitation, nor does it constitute investment advice, financial advice, or trading recommendations. Cryptocurrency mining and staking involve risks and the possibility of losing funds. It is strongly recommended that you perform due diligence before investing or trading in cryptocurrencies and securities, including consulting a professional financial advisor. Disclaimer: The above press release comes to you under an arrangement with GlobeNewswire. Business Upturn takes no editorial responsibility for the same. Ahmedabad Plane Crash
Business Upturn
26 minutes ago
- Business Upturn
HashFly Cloud Mining Helps Users Tap Into Daily Crypto Earnings Without Complexity
Dover, Delaware, June 20, 2025 (GLOBE NEWSWIRE) — In 2025, HashFly is making crypto mining easier than ever. By removing technical barriers and lowering entry costs, HashFly allows users to earn daily crypto income—no hardware or experience needed. As the cryptocurrency landscape evolves in 2025, HashFly is at the forefront of simplifying digital asset mining through its next-generation cloud mining platform. By removing technical barriers and minimizing entry costs, HashFly enables users worldwide to earn daily crypto income—without needing any hardware, coding skills, or blockchain expertise. Founded in 2013, HashFly has grown into one of the most trusted names in the cloud mining industry. Its platform allows anyone—from complete beginners to seasoned investors—to participate in Bitcoin (BTC) and Dogecoin (DOGE) mining through fully managed, legally compliant contracts. With prices starting at just $200, users can begin earning passive income in crypto immediately. 'Our mission at HashFly is to make crypto mining truly accessible,' said a spokesperson for HashFly. 'We've designed our platform to eliminate complexity. Users simply choose a mining contract, fund their account, and receive daily payouts—no setup or maintenance required.' Key Benefits of HashFly Cloud Mining: Daily Crypto Earnings : Users receive automatic daily payouts in BTC or DOGE. : Users receive automatic daily payouts in BTC or DOGE. Low Start-Up Cost : Contracts begin at $200, allowing anyone to participate. : Contracts begin at $200, allowing anyone to participate. No Hardware or Technical Skills Needed : 100% cloud-based mining managed by HashFly. : 100% cloud-based mining managed by HashFly. Transparent Pricing : No hidden fees—users always know what they're paying for. : No hidden fees—users always know what they're paying for. Global Accessibility : Available to users in over 100 countries. : Available to users in over 100 countries. Referral Program: Users earn bonuses for inviting friends to the platform. HashFly's Bitcoin and Dogecoin mining contracts typically generate estimated daily returns of 3–5%, depending on market conditions and contract size. The company has built a strong reputation for operational transparency, responsive customer service, and consistent payout performance—especially in regions where mining would otherwise be cost-prohibitive. As part of its 2025 roadmap, HashFly is also expanding its green mining infrastructure, leveraging renewable energy and AI-driven optimization to increase efficiency while reducing environmental impact. About HashFly HashFly is a leading cloud mining platform offering secure, compliant, and beginner-friendly access to cryptocurrency mining. Since its launch in 2013, HashFly has helped tens of thousands of users around the world earn crypto income without owning or managing mining equipment. To learn more or start mining today, visit: Disclaimer: The information provided in this press release does not constitute an investment solicitation, nor does it constitute investment advice, financial advice, or trading recommendations. Cryptocurrency mining and staking involve risks and the possibility of losing funds. It is strongly recommended that you perform due diligence before investing or trading in cryptocurrencies and securities, including consulting a professional financial advisor. Disclaimer: The above press release comes to you under an arrangement with GlobeNewswire. Business Upturn takes no editorial responsibility for the same. Ahmedabad Plane Crash
