Google shares 'mini incident report' on outage that disrupted services of Spotify, OpenAI and others: We are deeply sorry for ...
Alphabet's Google Cloud suffered an outage earlier today, disrupting services across multiple platforms, including Spotify, Discord, Snapchat, OpenAI among others. According to Downdetector.com, the downtime started around 1:50 p.m. ET (11:20 PM) and there were 14,729 reports of Google Cloud being down in the U.S. around 2:32 p.m. ET. Google Cloud acknowledged the outage and also resolved the outage. Issuing a fix for the same, the company said 'The issue with Google Chat, Google Meet, Gmail, Google Calendar, Google Drive, Google Cloud Search, Google Tasks, Google Voice has been resolved for all affected users'. It has now published a mini incident report of the incident.
Google says 'We are deeply sorry for the impact to all of our users and their customers that this service disruption/outage caused. Businesses large and small trust Google Cloud with your workloads and we will do better. In the coming days, we will publish a full incident report of the root cause, detailed timeline and robust remediation steps we will be taking. Given the size and impact of this incident, we would like to provide some information below.'
According to the Google Cloud status webpage, the outage lasted 3 hours. Here's the timeline shared by Google
(All Times US/Pacific)
Incident Start: 12 June, 2025 10:49
All regions except us-central1 mitigated: 12 June, 2025 12:48
Incident End: 12 June, 2025 13:49
Duration: 3 hours
Regions/Zones: Global
What Google's 'mini incident report' says on recent outage
As stated on Google Cloud status page, the mini incident report says:
Multiple Google Cloud and
Google Workspace products
experienced increased 503 errors in external API requests, impacting customers.
From our initial analysis, the issue occurred due to an invalid automated quota update to our API management system which was distributed globally, causing external API requests to be rejected. To recover we bypassed the offending quota check, which allowed recovery in most regions within 2 hours. However, the quota policy database in us-central1 became overloaded, resulting in much longer recovery in that region. Several products had moderate residual impact (e.g. backlogs) for up to an hour after the primary issue was mitigated and a small number recovering after that.
Google will complete a full Incident Report in the following days that will provide a detailed root cause.
The company further added that it will take the following measures to prevent future recurrence:
Prevent our API management platform from failing due to invalid or corrupt data.
Prevent metadata from propagating globally without appropriate protection, testing and monitoring in place.
Improve system error handling and comprehensive testing for handling of invalid data.
Android 16 IS HERE! Live Notifications, Tablet Desktop Mode & MORE!
AI Masterclass for Students. Upskill Young Ones Today!– Join Now
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Economic Times
an hour ago
- Economic Times
Shah Rukh Khan spotted with a surprise star on his lap during Sunday car drive; rolls up windows for privacy in viral video
(Catch all the Business News, Breaking News, Budget 2024 Events and Latest News Updates on The Economic Times.) Subscribe to The Economic Times Prime and read the ET ePaper online.
Time of India
2 hours ago
- Time of India
Nuvoco Vistas completes Rs 1800 cr Vadraj cement acquistion
Live Events (You can now subscribe to our (You can now subscribe to our Economic Times WhatsApp channel Nirma Group's Nuvoco Vistas Corp has made the Rs 1800 crore payment to lenders led by Punjab National Bank (PNB) and Union Bank of India completing its acquisition of the debt-ridden Vadraj Cement . The money was paid to lenders on Saturday, allowing them to write back their provisions this quarter, two people aware of the details said."The money came to lenders on Saturday and has been distributed. There were some delays due to some litigation but now that everything is settled, the company transferred the money well ahead of the June 24 deadline," said one of the persons cited with 25% of the more than Rs 8000 crore debt stands to gain Rs 431 crore, while Union Bank will get Rs 345 crore, calculations by ET acquisition will help Nuvoco Vistas boost its installed cement capacity by over 20% reaching around 31 MTPA and is the company's third acquisition after Lafarge Cement and Emami Cement. A Mumbai bench of the NCLT had approved the acquisition in Vadraj Cement, formerly owned by ABG Shipyard, has a 6 million tonne grinding unit in Surat and will add to Nuvoco Vistas' existing production capacity of 25 million tonne by more than 20%.The acquisition was undertaken through Vanya Corp , a wholly-owned subsidiary of Nuvoco Vistas. Subsequently, Vanya will be merged with Vadraj Cement, according to the resolution plan. Vadraj Cement will ultimately become the wholly-owned subsidiary of the Rs 1,800 crore offer outbid Adani Group at an auction under the court-monitored corporate insolvency, ET had reported in January this year. Adani group-backed Ambuja Cement had partnered with Prudent ARC-backed RKG Fund to acquire the Gujarat-based cement the Rs 1,800 crore offered by Nuvoco Vistas, Rs 1,725 crore will be used for repaying financial creditors' dues, and the balance is set aside for operational credit, dues to employees, an insolvency resolution process costs.
Economic Times
4 hours ago
- Economic Times
Former Meta VP Karandeep Anand takes on CEO role at Character. ai
Live Events Google-backed AI chatbot service Character. ai has appointed Karandeep Anand as its next chief executive officer on to this, he was vice president and head of business products at Meta . He has also held executive roles at the new role, Anand will focus on advancing Character. ai's long term strategy to enhance multimodal-AI technology and expand the user has been a board advisor to Character. ai for the last nine months. In a note, he laid out plans for the company over the next 60 days. These plans include working on refining open source models in an attempt to improve memory and overall model quality. He also aims to improve search and discoverability features to help users navigate parallel, Anand hinted at expanding Character. ai's creative toolkit to help creators design richer, immersive characters, with audio and video give users better control, he said he is going to make the content filters less overbearing to ease out restrictions. Additionally, he aims to roll out 'Archive' option to allow users to hide or archive characters if they wish company also announced Dominic Perella as chief legal officer and senior vice president (SVP) of global ai uses deep learning models similar to GPT-type models, offering conversational AI characters while also allowing character creation. However, it does not support generating images or code, making it a solely text-based model.
