SigOpt incident

API 504s Failing Requests

Critical Resolved View vendor source →

SigOpt experienced a critical incident on September 16, 2020 affecting API, lasting 2h 59m. The incident has been resolved; the full update timeline is below.

Started
Sep 16, 2020, 10:24 PM UTC
Resolved
Sep 17, 2020, 01:24 AM UTC
Duration
2h 59m
Detected by Pingoru
Sep 16, 2020, 10:24 PM UTC

Affected components

API

Update timeline

  1. investigating Sep 16, 2020, 10:28 PM UTC

    We are currently investigating this issue and have identified machines failing healthchecks.

  2. identified Sep 16, 2020, 10:42 PM UTC

    We identified an issue with AWS Identity and Access Management( https://status.aws.amazon.com/ ) that was causing API machines to fail. We have identified a solution and are in the process of testing and deploying a fix.

  3. identified Sep 16, 2020, 10:44 PM UTC

    API is now operational, we are continuing to monitor the situation.

  4. identified Sep 16, 2020, 10:46 PM UTC

    API is now operational, we are continuing to monitor the situation.

  5. monitoring Sep 16, 2020, 11:01 PM UTC

    Continuing to monitor situation. All systems are operational.

  6. resolved Sep 17, 2020, 01:24 AM UTC

    AWS Identity and Access Management incident is now fully resolved. All systems fully operational.