Skylight incident

Data Processing Delay

Major Resolved View vendor source →

Skylight experienced a major incident on November 7, 2022 affecting Application, lasting 3h 48m. The incident has been resolved; the full update timeline is below.

Started
Nov 07, 2022, 10:20 PM UTC
Resolved
Nov 08, 2022, 02:09 AM UTC
Duration
3h 48m
Detected by Pingoru
Nov 07, 2022, 10:20 PM UTC

Affected components

Application

Update timeline

  1. identified Nov 07, 2022, 10:20 PM UTC

    One of our processors is encountering errors while processing traces, we have taken the worker offline to work on a fix. This is affecting a portion of our customers – if your app is affected you may see missing data on the Skylight dashboard starting from around 20:50 UTC. We expect the missing data to be filled in once we resume processing.

  2. monitoring Nov 07, 2022, 10:52 PM UTC

    We have deployed a fix and processing has resumed for the affected customers. It may take some time for the processing to catch up, data will start to appear in the order they were received.

  3. monitoring Nov 07, 2022, 10:52 PM UTC

    We have deployed a fix and processing has resumed for the affected customers. It may take some time for the processing to catch up, data will start to appear in the order they were received.

  4. resolved Nov 08, 2022, 02:09 AM UTC

    Processing is fully caught up.