FlagSmith incident

Core API is not responding

Critical Resolved View vendor source →

FlagSmith experienced a critical incident on July 10, 2022 affecting Admin API, lasting 3h 22m. The incident has been resolved; the full update timeline is below.

Started
Jul 10, 2022, 05:53 PM UTC
Resolved
Jul 10, 2022, 09:15 PM UTC
Duration
3h 22m
Detected by Pingoru
Jul 10, 2022, 05:53 PM UTC

Affected components

Admin API

Update timeline

  1. investigating Jul 10, 2022, 05:53 PM UTC

    We are investing an outage on our Core API.

  2. identified Jul 10, 2022, 06:04 PM UTC

    This looks to be an issue with AWS where our Core API is located. We are investigating.

  3. identified Jul 10, 2022, 06:24 PM UTC

    AWS have confirmed an outage in their EU-West-2 data center. We are monitoring and waiting on AWS to provide updates.

  4. identified Jul 10, 2022, 07:51 PM UTC

    AWS are restoring services. We hope to have the API back up shortly.

  5. monitoring Jul 10, 2022, 08:09 PM UTC

    The DB has recovered. API latency is high as our ECS cluster scales out.

  6. monitoring Jul 10, 2022, 08:36 PM UTC

    We are still seeing issues with the ECS cluster scaling out correctly, again down to the recent AWS eu-west-2 outage. We are monitoring.

  7. resolved Jul 10, 2022, 09:15 PM UTC

    This incident has been resolved.