Scout APM incident

UI unavailable

Critical Resolved View vendor source →

Scout APM experienced a critical incident on November 30, 2017, lasting 1h 1m. The incident has been resolved; the full update timeline is below.

Started
Nov 30, 2017, 09:04 PM UTC
Resolved
Nov 30, 2017, 10:06 PM UTC
Duration
1h 1m
Detected by Pingoru
Nov 30, 2017, 09:04 PM UTC

Update timeline

  1. investigating Nov 30, 2017, 09:04 PM UTC

    The Scout UI is currently unavailable. We're investing an issue with our backend timeseries storage.

  2. identified Nov 30, 2017, 09:09 PM UTC

    InfluxDB hung while removing a significant amount of data from a timeseries database. We're restarting InfluxDB, which should take around 30 minutes. Data ingestion is continuing - charts will be a bit behind as we replay checkins to Influx after it comes back online.

  3. monitoring Nov 30, 2017, 09:21 PM UTC

    The UI is available again. There is a 20 minute lag in data. We've begun replaying data ingestion to fill in the gap.

  4. resolved Nov 30, 2017, 10:06 PM UTC

    Charts should be caught back up - all systems back to normal.