Google suffered major outages with its Cloud Platform on Sunday, causing widespread access issues with both its own services and third party apps ranging from Snapchat to Discord. As of early Sunday evening, issues had persisted for hours; according to the Google Cloud Status Dashboardthe outages began at roughly p.
Finally, the G Suite Status Dashboard listed virtually every one of its cloud-based productivity and collaboration tools—including Gmail, Drive, Docs, Hangouts, and Voice—as experiencing service outages. As the Verge notedthird-party services Discord, Snapchat, and Vimeo all use Google Cloud in their backends, with the outages preventing users from logging in.
However, issues were far from universal, with some users reporting no impact at all. In a statement to Gizmodo and other outlets, the Google press team acknowledged the extent of the outages, reiterated the note about network congestion, and said it had identified the problem and expected it to be resolved quickly. Later that year, YouTube was went down hard for over an hour, with videos refusing to load and access problems reported across the globe—a situation that repeated itself earlier this year.
Users across the planet have also reported problems logging into their Gmail accounts on multiple occasions in While Google sorts this mess out, disaffected users have a couple of options to occupy their time, including but not limited to going outside or complaining about it on Twitter.
In an update posted to the Cloud Status Dashboard shortly after p. ET, Google said it had resolved the issues within the previous hour. It added that it would be conducting an investigation of the downtime:. We will conduct an internal investigation of this issue and make appropriate improvements to our systems to help prevent or minimize future recurrence. We will provide a detailed report of this incident once we have completed our internal investigation.
Discord, Snapchat, and Vimeo users are also affected, as these all use Google Cloud on the backend. Even Shopify experienced problems because of the Google outage, which prevented some stores both brick-and-mortar and online from processing credit card payments for hours. The problems for YouTube follow high profile outages for the popular video service in January and October.
Next Up In Tech.
Google recovers from outage that took down YouTube, Gmail, and Snapchat
Sign up for the newsletter Processor A newsletter about computers Email required. By signing up, you agree to our Privacy Notice and European users agree to the data transfer policy. Loading comments Share this story Twitter Facebook.This page provides status information on the services that are part of Google Cloud Platform.
Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit cloud. On Sunday 2 June,Google Cloud projects running services in multiple US regions experienced elevated packet loss as a result of network congestion for a duration of between 3 hours 19 minutes, and 4 hours 25 minutes.
The duration and degree of packet loss varied considerably from region to region and is explained in detail below. Other Google Cloud services which depend on Google's US network were also impacted, as were several non-Cloud Google services which could not fully redirect users to unaffected regions.
Customers may have experienced increased latency, intermittent errors, and connectivity loss to instances in us-central1, us-east1, us-east4, us-west2, northamerica-northeast1, and southamerica-east1. Google Cloud instances in us-west1, and all European regions and Asian regions, did not experience regional network congestion. G Suite services in these regions were also affected.
A detailed assessment of impact is at the end of this report. This was a major outage, both in its scope and duration. As is always the case in such instances, multiple failures combined to amplify the impact.
Within any single physical datacenter location, Google's machines are segregated into multiple logical clusters which have their own dedicated cluster management software, providing resilience to failure of any individual cluster manager. Google's network control plane runs under the control of different instances of the same cluster management software; in any single location, again, multiple instances of that cluster management software are used, so that failure of any individual instance has no impact on network capacity.
Google's cluster management software plays a significant role in automating datacenter maintenance events, like power infrastructure changes or network augmentation. Google's scale means that maintenance events are globally common, although rare in any single location. Jobs run by the cluster management software are labelled with an indication of how they should behave in the face of such an event: typically jobs are either moved to a machine which is not under maintenance, or stopped and rescheduled after the event.
Two normally-benign misconfigurations, and a specific software bug, combined to initiate the outage: firstly, network control plane jobs and their supporting infrastructure in the impacted regions were configured to be stopped in the face of a maintenance event. Secondly, the multiple instances of cluster management software running the network control plane were marked as eligible for inclusion in a particular, relatively rare maintenance event type.
Thirdly, the software initiating maintenance events had a specific bug, allowing it to deschedule multiple independent software clusters at once, crucially even if those clusters were in different physical locations. Those logical clusters also included network control jobs in other physical locations. The automation then descheduled each in-scope logical cluster, including the network control jobs and their supporting infrastructure in multiple physical locations.
Google's resilience strategy relies on the principle of defense in depth. Specifically, despite the network control infrastructure being designed to be highly resilient, the network is designed to 'fail static' and run for a period of time without the control plane being present as an additional line of defense against failure.
The network ran normally for a short period - several minutes - after the control plane had been descheduled. After this period, BGP routing between specific impacted physical locations was withdrawn, resulting in the significant reduction in network capacity observed by our services and users, and the inaccessibility of some Google Cloud regions.
Google engineers were alerted to the failure two minutes after it began, and rapidly engaged the incident management protocols used for the most significant of production incidents. Debugging the problem was significantly hampered by failure of tools competing over use of the now-congested network.Ben Schoon. In what seems to be a relatively widespread outage, Google services ranging from Search to Gmail are having problems.
Reports started popping up for some major services, like YouTube and Search on DownDetector in the past several minutes, and Twitter has also seen plenty of user reports as well. Update: As of Sunday evening, this issue seems largely resolved as services come back online. The Nest app also kicks back an error message on start.
This means that it affects third-party services such as Snapchat and Discord among others.
Based on DownDetector reportsit seems this issue is primarily occurring on the East Coast of the United States, but some issues are reported in more regions around the globe. Hopefully, Google can squash this bug quickly. FTC: We use income earning auto affiliate links. Check out 9to5Google on YouTube for more news:. Stay up to date on news from Google headquarters.
YouTube is Google's massive video streaming platform, accepting videos from creators large and small. Find him on Twitter NexusBen. Send tips to schoon 9to5g. June 2, Be sure to check out our homepage for all the latest news, and follow 9to5Google on TwitterFacebookand LinkedIn to stay in the loop.
Google Cloud is Down!! 6/2/2019
Check out our exclusive storiesreviewshow-tosand subscribe to our YouTube channel. Ben Schoon's favorite gear.It was not clear what specifically was behind the network problems, which Google said it first began investigating around 4 p.
Eastern time. Google did not say how it believes the problems originated. The issues appeared to affect more than a dozen Google servicesincluding its cloud computing technology, which is used by many companies to power their own services and apps.
Google said the problems were not caused by a cyberattack, as hypothesized by some on social media. Contained largely to the Eastern United States, and to a few hours on a Sunday evening, the disruptions appeared to cause less of a headache than they would have if they had hit on a busier workday. Users reported problems with Snapchat and Discord, a voice and text chat app for gamers. Shopify, an e-commerce platform that powers thousands of stores, also reported being affected.
A Google spokesman could not immediately provide more specifics and said the company was still investigating. Cloud computing, in which companies pay to run their online applications in data centers operated by providers like Google, has been hit by problems before. Inan Amazon employee entered an incorrect set of commands on a computer and knocked out a set of servers in an Amazon data center. Many were affected by that hiccup, including Slack, Quora and the technology news site The Verge.
Home Page World U.No, it's not just you -- many of the internet services you use went down this weekend. Google has reported an outage with its Cloud Platform that made several sites and apps inoperable in some regions on June 2nd they're still affected as we write this. Most of them are in-house services like Gmail, G Suite and YouTube, but this also affected Discord, Snapchat and other apps that depend on Google's infrastructure. The issues were mostly noticeable in the US and Europe.
Details are still forthcoming as of this writing, although Google said this was "related to a larger network issue" in its status update. A Google spokesperson told Engadget that the problem involved "high levels of network congestion" in the eastern US, and that the company believed it had nailed down the "root cause" of the issue with service resuming soon.McAfee Arrested, Google Cloud Joins EOS, and MORE!
While outages like this rarely last long, they've happened more than once for Google in recent months. YouTube faced downtime in October, for example, while Google's overall services went offline in November due to a routing issue.
Google Cloud Networking Incident #19009
Nest also suffered a string of outages in late and early Reliability is clearly posing something of a challenge for the company, even though there's no one common cause.
It hasn't detailed the cause beyond what it said before, but it's promising to conduct a "post mortem" and make "appropriate improvements" to prevent a repeat.
Buyer's Guide. Log in. Sign up. Prison video visitation system exposed calls between inmates and lawyers. Google drops curated news plans in Australia over 'unworkable' policy. Latest in Gear. Image credit:. Sponsored Links. In this article: discordg suitegeargmailgooglegoogle cloudinternetservicessnapchatyoutube. All products recommended by Engadget are selected by our editorial team, independent of our parent company.
Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission. FBI sent a team to 'exploit' Portland protesters' phones.
Razer's first gaming chair improves your posture. From around the web. Page 1 Page 1 ear icon eye icon Fill 23 text file vr.We wanted to bring some clarity to help businesses ask for reviews in a smarter way. For stores that use Yotpo, about 6. The data shows that including words that signify a financial incentive to leaving a review (like coupon, win, free, save, sale, discount, etc.
For these stores, adding exclamations can lead to a 83. Yotpo eCommerce Benchmark How do you stack up to the competition. Get my free downloadGet Your Free Copy. Yotpo eCommerce Benchmark How do you stack up to your competition. Get your free copyData from over 150,000 eCommerce Businesses Aimee Millwood, Director of Content at YotpoAimee loves hummus and hates misplaced commas.
Let's make the most of our timeMore info helps us prepare the best and most personalized call for you. You've successfully been subscribed - check your inbox weekly for marketing awesomeness.
A customer review is a review of a product or service made by a customer who has purchased the product or service. Customer reviews are a form of customer feedback on electronic commerce and online shopping sites.
There are also dedicated review sites, some of which use customer reviews as well as or instead of professional reviews. The reviews may themselves be graded for usefulness or accuracy by other users. The reliability of customer reviews has been questioned. Since few sites restrict users to reviewing only items purchased from that site, it is difficult to prove a customer has actually used the product they are reviewing.
Before the advent of the internet, methods by which customers could review products and services included customer comment boxes and customer service helplines. These methods are still in existence today although internet review sites have grown significantly in recent years. One of the first review sites was Epinions, established in 1999. Humorous customer reviews are common on some major shopping sites, such as Amazon.
These are often ironically or sarcastically laudatory reviews of products deemed kitsch or mundane. Another example is methylated spirits described in the style of a wine review. Please help improve this article by adding citations to reliable sources.
Sharing real time experience of your buyers on your website, blogs, social media accounts, etc. Here are some eye-popping stats that reflect why customer reviews are so important when marketing your business and brand in the ever-so-competitive market:Reviews can make or break a brand and encouraging satisfied customers to share their positive experience online, especially on social media platforms can help businesses generate social proof of their efficient services.