FlagSmith incident

API occasionally slow or returning HTTP status 500

Notice Resolved View vendor source →

FlagSmith experienced a notice incident on October 8, 2020 affecting Admin API, lasting —. The incident has been resolved; the full update timeline is below.

Started
Oct 08, 2020, 08:59 AM UTC
Resolved
Oct 08, 2020, 08:59 AM UTC
Duration
—
Detected by Pingoru
Oct 08, 2020, 08:59 AM UTC

Affected components

Admin API

Update timeline

  1. resolved Oct 08, 2020, 08:59 AM UTC

    Over a period of 5 days we experienced either slowdowns or 500 error response codes from our API. These brown-outs occurred for around 1 minute, 4 times a day. This was due to a misconfiguration on a client's SDK implementation that was sending us very high bursts in traffic following a push notification that was sent out to a large user population. In order to mitigate this outage, we have upsized our core database with 8x the capacity, and our app server cluster with 16x the capacity. This has provided us with enough capacity to serve these traffic bursts. We have also been in contact with the customer to help improve their SDK implementation to reduce the load on our API. We apologise for the degradation in service.