Amazon’s Elastic Cloud Compute (EC2) in North Virginia was suffering some minor issues yesterday, which quite simply escalated quickly, becoming a full-blown outage of AWS in North Virginia.

Many major internet services and sites were affected, such as Reddit, Foursquare, Minecraft and Heroku, were all down for most of the day with many more suffering outages and issues for many users around the world.

Reddit was the first I noticed go down, this much was evident by the amount of work I got done today (a lot) and the number of lolcats I posted on Facebook (few). But joking aside, these are some major websites that are hanging at the mercy of Amazon, while the world isn't going to stop turning because people can't access Minecraft servers, these sort of issues cause widespread disruptions and generally end up costing many companies a lot of money in lost revenue.

It wasn't long before the issue began to spread, with Pinterest, Airbnb, ElastiCach and CloudWatch following later in the day and suffering poor loading times and connectivity issues, no doubt many more smaller sites have been affected too, but not all of them are going to make the headlines.

From Amazon’s AWS status page:

• 10:38 AM PDT We are currently investigating degraded performance for a small number of EBS volumes in a single Availability Zone in the US-EAST-1 Region.
• 11:11 AM PDT We can confirm degraded performance for a small number of EBS volumes in a single Availability Zone in the US-EAST-1 Region. Instances using affected EBS volumes will also experience degraded performance.
• 11:26 AM PDT We are currently experiencing degraded performance for EBS volumes in a single Availability Zone in the US-EAST-1 Region. New launches for EBS backed instances are failing and instances using affected EBS volumes will experience degraded performance.

Then the Relational Database Service went down:

• 11:03 AM PDT We are currently experiencing connectivity issues and degraded performance for a small number of RDS DB Instances in a single Availability Zone in the US-EAST-1 Region.
• 11:45 AM PDT A number of Amazon RDS DB Instances in a single Availability Zone in the US-EAST-1 Region are experiencing connectivity issues or degraded performance. New instance create requests in the affected Availability Zone are experiencing elevated latencies. We are investigating the root cause.

The Elastic Beanstalk:

• 11:06 AM PDT We are currently experiencing elevated API failures and delays launching, updating and deleting Elastic Beanstalk environments in the US-East-1 Region.
• 11:45 AM PDT We are continuing to see delays launching, updating and deleting Elastic Beanstalk environments in the US-East-1 Region.

The list goes on, while most services have been fully restored, you can expect the usual minor delays and issues while the issues are being fully resolved.

TL:DR

Amazons servers broke, half the internet went off for most of the day. But it's mostly ok now.

Enjoyed this article? share it!