Speed Means Nothing If You're Down: Benchmarking For The Real World
Spencer Kimball is the CEO and co-founder of Cockroach Labs.
For decades, database performance benchmarks like TPC-C (Transaction Processing Performance Council Benchmark C) chased peak throughput under ideal conditions. Systems were scaled vertically and micro-optimized at every layer to game benchmarks and maximize transactions per second (TPS). But times—and technology—have changed.
Today's applications live everywhere: across regions, clouds and availability zones. They're always on, global and expected to perform flawlessly despite disruptions. Users now demand instant banking balances, lag-free global broadcasts, immediate access to patient records and real-time inventory updates across international supply chains. These aren't aspirations; they're baseline expectations, assumed and demanded unequivocally.
Modern workloads are unpredictable, highly distributed and intensely data-driven. Fraud detection, logistics tracking and AI-powered automation now run continuously at a global scale. Autonomous systems assume constant availability and consistency. They don't pause for outages or wait for recovery. They expect the system to be fast, consistent and always available.
Yet legacy benchmarks still focus on raw throughput, rarely accounting for the realities of modern architecture: latency spikes, node crashes or regional outages. The true measure of performance isn't speed under ideal conditions—it's resilience under failure.
If anyone doubts the importance of resilience, recent history is rife with cautionary tales.
• Costco's Black Friday outage in 2019 allegedly cost millions in sales.
• Ticketmaster's 2022 crash during Taylor Swift's ticket sales revealed its infrastructure was unprepared for massive spikes.
• A faulty update in 2024 froze hospital electronic health records, forcing clinicians to revert to paper and risking patient safety.
• CrowdStrike's 2024 outage halted global freight logistics due to insufficient resilience planning.
• Barclays and Capital One outages in 2025 left millions unable to access banking services, demonstrating that even leading institutions aren't immune.
There is a perennial thread running through this representative sampling of recent failures: The rising complexity of modern applications requires a shift in mindset to resilience as a first-order goal.
Modern infrastructure complexity—multiregion, multicloud and governed by stringent regulations like GDPR, PDPA and DORA—demands new benchmarks that prioritize resilience as a fundamental metric, not an afterthought. Benchmarks that ignore this operational and compliance complexity are no longer sufficient.
True resilience testing involves deliberately introducing controlled chaos: killing nodes, dropping disks, simulating outages. The objective is clear: Observe the system's behavior under stress. Does it reroute traffic seamlessly? Are transactions duplicated, delayed or lost? How rapidly does performance return to baseline? These aren't trivial operational details—they're critical indicators of system integrity.
Chaos testing, a methodology where systems are intentionally stressed to uncover hidden vulnerabilities, is gaining traction. However, resilience testing often remains disconnected from standard performance metrics like throughput and latency. Integrating these tests ensures resilience isn't merely theoretical but quantifiable and central to system design.
Just as vehicle performance isn't judged solely by top speed, database benchmarks shouldn't focus exclusively on maximum throughput. Benchmarks must evolve to measure continuity, recovery speed and stability under real-world pressures. Systems engineered with built-in replication, self-healing automation and geographic consensus aren't merely technically superior; they're strategically essential. These aren't just engineering choices; they're risk strategies. And they should be part of how we measure value.
Speed without resilience is meaningless. Challenge your teams and vendors to prove resilience under chaos. If they can't, they're not ready for today's demands.
The ultimate benchmark isn't the fastest lap—it's staying on track when legacy systems are stuck rebuilding in the pit.
Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
36 minutes ago
- Yahoo
S&P 500-listed CEO Brian Armstrong warns of looming U.S. debt crisis
S&P 500-listed CEO Brian Armstrong warns of looming U.S. debt crisis originally appeared on TheStreet. Brian Armstrong, CEO of Coinbase, issued a dire warning about the state of the global economy this week, pointing to soaring debt, inflation, and declining economic freedom as the key drivers of rapidly increasing crypto adoption. In a post on X, Armstrong stated, "The world needs crypto, now more than ever," while posting a chart that U.S. federal debt surpassed $34 trillion. Armstrong characterized crypto as a means to regain financial sovereignty, giving individuals the ability to avoid centralized institutions and be able to access fast and cheap global payments. "Economic freedom means it's your money," he shared while referencing the growing demand for Bitcoin and stablecoins as an inflation hedge against out-of-control fiscal policy. His explanation of Coinbase's phased strategy is in three phases. It started as a crypto investment platform, expanded into financial services, and is evolving into an application layer for the next generation of internet tools. He continued explaining the growth of Bitcoin's all-time high and stablecoins, which are adopting more quickly as proof that crypto is "eating the financial services industry." Coinbase made four announcements at its 2025 State of Crypto Summit: Coinbase Business for startups; payment APIs for easy USDC settlements (with Shopify as a proof point), options trading via Deribit integration, and a new Coinbase card with an American Express partnership offering up to 4% Bitcoin rewards. "People are feeling a lack of trust in their money and deficit spending," Armstrong said. "Crypto is the solution—and Coinbase is leading the charge." He added that this movement is not just about price, but about "building a financial system from the ground up." S&P 500-listed CEO Brian Armstrong warns of looming U.S. debt crisis first appeared on TheStreet on Jun 20, 2025 This story was originally reported by TheStreet on Jun 20, 2025, where it first appeared.
Yahoo
44 minutes ago
- Yahoo
Philip Morris (PM) Defies the Naysayers as Smoking Stays Hot in 2025
Imagine a tobacco stock surging 53% in six months—yet that's exactly what Philip Morris International (PM) has achieved, defying the usual stigma attached to sin stocks and a declining global smoker base. Unlike many of its peers, PM's story stands apart: its traditional cigarette business remains stable, heated tobacco products are experiencing rapid growth, and oral nicotine offerings are gaining momentum. Easily unpack a company's performance with TipRanks' new KPI Data for smart investment decisions Receive undervalued, market resilient stocks right to your inbox with TipRanks' Smart Value Newsletter Add a weak dollar boosting its predominantly international revenue, and it's clear PM's growth engine is running strong, justifying the rally and potentially signaling more upside ahead. Cigarettes may seem like a dying product, but Philip Morris International's (PM) combustible division is proving otherwise. In Q1, cigarette shipment volumes rose 1.1% to 144.8 billion units, and organic revenue increased 4%, fueled by an 8.3% price hike. Marlboro's enduring brand strength, along with a 0.4% market share gain to 24.8% (excluding the U.S. and China), highlights PM's pricing power and market resilience. Strategic local manufacturing has also helped preserve margins amid rising raw material costs. The results speak for themselves: combustible gross profit rose 5.3% organically, even with some headwinds from a commercial model change in Indonesia. PM's ability to raise prices without sacrificing volume underscores the strength of its brand. While the global cigarette market is shrinking by roughly 2% annually, PM's smart execution keeps the segment profitable, helping fund its transition to next-generation nicotine products. If combustibles are PM's foundation, IQOS is the growth engine. Heated tobacco unit (HTU) shipments surged 14.4% to 37.1 billion units last quarter, while global in-market sales rose 9.4%, including a 9.3% increase in Japan, where IQOS now holds a commanding 32.2% market share. Europe is also a key growth driver, with countries such as Hungary (41.9%) and Greece (34.4%) reporting impressive market penetration. Backed by $14 billion in R&D since 2008, IQOS now delivers higher margins than cigarettes, proving the investment is paying off. The strength lies in PM's efficient scale and relentless innovation. Its multi-category approach—bolstered by launches like IQOS ILUMA in Japan—continues to deepen consumer loyalty. Even amid challenges like the EU flavor ban in Italy, PM has offset losses with strong double-digit growth in Spain and Germany. With 38.6 million adult users globally, IQOS is far from niche—it's a global force driving PM's next phase of growth. Then there's ZYN, Philip Morris's nicotine pouch brand, which is rapidly gaining traction in the U.S. ZYN shipments soared 53% to 202 million cans last quarter, prompting the company to raise its full-year guidance to 800–840 million cans. International markets also contributed, with 53% growth in countries such as Pakistan and the UK. Thanks to margins exceeding 70%—about five points higher than those of combustibles—ZYN played a key role in helping smoke-free products contribute 44% of the total gross profit. Smart moves, such as early capacity expansions in March, ensured that supply kept up with demand. But ZYN isn't just a U.S. story—it's a global growth play. With 182% volume growth in non-Nordic international markets, PM is leveraging its global distribution muscle and FDA clearances to accelerate expansion. The 27.2% volume growth in Q1 reflects PM's successful pivot toward discreet, high-margin alternatives that resonate with younger consumers and working professionals. It's a textbook example of how to spot and capitalize on shifting consumer preferences. After an 80% rally, you might expect Philip Morris to be overvalued—but its forward P/E of 23, based on projected 2025 adjusted EPS of $7.36–$7.49, tells a more nuanced story. While that's not cheap for a tobacco stock, PM is far from typical. With 12–14% organic EPS growth forecasted for 2025—driven by 20.4% growth in smoke-free revenue and a weak dollar amplifying its 90%+ international earnings—this valuation appears well-supported. The weak dollar, in particular, is an underappreciated tailwind, boosting earnings in key international markets, such as Japan and Europe. Add to that $180 million in Q1 cost savings and a $2 billion efficiency target by 2026, and PM is positioned to continue expanding margins despite headwinds such as tax pressures in India. Altogether, this creates a strong case for PM to deliver 15%+ EPS growth annually in the coming years, making today's valuation look not just justified, but compelling. Wall Street remains highly bullish on Philip Morris, with a Strong Buy consensus based on eight Buy and one Hold rating over the past three months, and notably, no Sell ratings. However, PM's average 12-month stock price target of $188.67 suggests a meagre 3.3% upside over the coming year. Philip Morris is no longer your grandfather's tobacco company. Its recent surge reflects a bold transformation toward smoke-free alternatives, with ZYN and IQOS driving growth while traditional cigarettes continue to generate solid cash flow. A weak dollar is further boosting its international-heavy revenue base, and with 12–14% EPS growth projected, PM's momentum looks far from accidental—it's the mark of a company redefining its future. While its P/E of 23 isn't bargain-basement, it's a reasonable price for a business evolving into a modern, high-margin growth story. In my view, PM still appears to be an attractive option. Disclaimer & DisclosureReport an Issue Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
an hour ago
- Yahoo
A massive trove of 16 billion stolen passwords was discovered — here's what to do
Researchers say they uncovered a massive data leak exposing 16 billion login credentials. The leak involves logins for platforms like Apple, Gmail, and Facebook, posing security risks. Companies advise using two-step authentication and passkeys to protect your accounts. Researchers say they've uncovered one of the largest data leaks in history that involves many popular platforms. The leak includes nearly 16 billion login credentials that could give cybercriminals access to social media and business platforms such as Apple, Gmail, Telegram, Facebook, GitHub, and more, researchers at Cybernews said this week. Bad actors now have "unprecedented access to personal credentials that can be used for account takeover, identity theft, and highly targeted phishing," the researchers said. The number of exposed people or accounts is unknown. The researchers said the data likely comes from malicious software known as infostealers. "What's especially concerning is the structure and recency of these datasets — these aren't just old breaches being recycled. This is fresh, weaponizable intelligence at scale," the researchers said. Cybernews said researchers uncovered the leak when the datasets were exposed for a short period of time. It follows the May discovery of a database containing more than 184 million credentials, including Apple, Facebook, and Google logins, Wired earlier reported. If you're nervous that your logins are at risk, there are steps you can take to make your account safer. You can't unring the bell of an information leak. However, you can take steps to identify if your credentials have been involved in any data breaches and protect yourself in the future. You can check sites like Have I Been Pwned to see if your email has appeared in a data breach. Turning on two-step authentication for your accounts can also help protect them from unauthorized access. Platforms also offer resources to help users secure their accounts. Google encourages users to use protections that don't require a password, like a passkey. It's one of the tech giants, along with Apple, Amazon, and Microsoft, that have been working to move users away from passwords to help secure their accounts. For those who prefer to stick with passwords, Google's password manager can store login credentials and notify users if they appear in a breach, a spokesperson told Business Insider. There's also Google's dark web report, a free tool that tracks whether personal information is floating around in online databases. GitHub, an online coding platform, offers developers a guide on how to implement safety measures in their organizations. The site recommends creating a security policy, having strict password guidelines, and requiring two-factor authorization. The data leak included logs — "often with tokens, cookies, and metadata," which makes it "particularly dangerous for organizations lacking multi-factor authentication or credential hygiene practices," the Cybernews team said. Meta offers a Privacy Checkup tool for users to review their privacy and security account settings. There, you can turn on two-factor authentication and ensure Meta alerts you of unusual logins. Meanwhile, Telegram said its primary login method sends a one-time password to users over SMS. "As a result, this is far less relevant for Telegram users compared to other platforms where the password is always the same," a Telegram spokesperson told BI about the data leak. Apple, GitHub, and Meta did immediately respond to a request for comment on the data leak. Google said it was directing users to some of the security resources above. Read the original article on Business Insider
