OpenWater incident

Amazon S3 Outage

Major Resolved View vendor source →

OpenWater experienced a major incident on February 28, 2017, lasting 4h 27m. The incident has been resolved; the full update timeline is below.

Started
Feb 28, 2017, 05:51 PM UTC
Resolved
Feb 28, 2017, 10:19 PM UTC
Duration
4h 27m
Detected by Pingoru
Feb 28, 2017, 05:51 PM UTC

Update timeline

  1. monitoring Feb 28, 2017, 05:51 PM UTC

    Amazon S3 is currently having an outage in their US regions which is impacting the OpenWater platform. We are monitoring their services carefully and will provide an update when they provide resolution. This impacts our customers in the sense that entrants will not be able to upload files. There may also be theme issues and images may not load.

  2. monitoring Feb 28, 2017, 06:07 PM UTC

    You can follow along with Amazon's updates here: https://status.aws.amazon.com/

  3. monitoring Feb 28, 2017, 07:26 PM UTC

    Amazon is continuing to work on the issue. The outage has impacted a large portion of the internet: http://bgr.com/2017/02/28/internet-outage-amazon-web-services/.

  4. monitoring Feb 28, 2017, 07:42 PM UTC

    We have added an alert bar to all customer pages to notify end users of the outage. We will continue to monitor and post updates here until the outage has been resolved. Additional news coverage of the incident - https://techcrunch.com/2017/02/28/amazon-aws-s3-outage-is-breaking-things-for-a-lot-of-websites-and-apps/ - http://www.usatoday.com/story/tech/news/2017/02/28/amazons-cloud-service-goes-down-sites-scramble/98530914/

  5. monitoring Feb 28, 2017, 08:56 PM UTC

    Amazon has reported the underlying issue is fixed and all systems should be back to normal within an hour. We will continue to monitor the situation and post updates.

  6. monitoring Feb 28, 2017, 09:56 PM UTC

    Amazon reports all pages should now load fine; file uploads will still be intermittent for the next hour.

  7. resolved Feb 28, 2017, 10:19 PM UTC

    Amazon reports all systems are clear. We tested OpenWater to ensure all is working well and have removed the alert banner from all customer nodes. We see our other partners reporting similiar results and are considering the case resolved. We will continue to monitor through the night and re-open the incident if necessary.