Uploadcare incident

Uploadcare services have degraded performance

Minor Resolved View vendor source →

Uploadcare experienced a minor incident on February 28, 2017, lasting 5h 54m. The incident has been resolved; the full update timeline is below.

Started
Feb 28, 2017, 05:48 PM UTC
Resolved
Feb 28, 2017, 11:43 PM UTC
Duration
5h 54m
Detected by Pingoru
Feb 28, 2017, 05:48 PM UTC

Update timeline

  1. investigating Feb 28, 2017, 05:48 PM UTC

    Our CDN is down. Investigating.

  2. identified Feb 28, 2017, 05:58 PM UTC

    AWS S3 is experiencing increased error rates that results in all of our buckets going AWOL.

  3. identified Feb 28, 2017, 09:24 PM UTC

    AWS has fixed working with existing S3 objects, so CDN and subset of REST API are working at the moment. More details on AWS status: https://status.aws.amazon.com/

  4. monitoring Feb 28, 2017, 10:33 PM UTC

    AWS has reported that everything is green. We're working on recovering affected Uploadcare components. Currently, everything should work but higher latency and error rate are expected.

  5. monitoring Feb 28, 2017, 10:48 PM UTC

    AWS Autoscaling is still down, we're deploying new instances manually.

  6. identified Feb 28, 2017, 10:54 PM UTC

    Upload API went down.

  7. monitoring Feb 28, 2017, 10:59 PM UTC

    Upload API is up again. We continue monitoring all components.

  8. resolved Feb 28, 2017, 11:43 PM UTC

    Currently, Uploadcare service is fully working. We continue monitoring the situation closely.