Lightstep incident

intermittent gaps in streams data

Notice Resolved View vendor source →

Lightstep experienced a notice incident on June 23, 2022, lasting 1h 7m. The incident has been resolved; the full update timeline is below.

Started
Jun 23, 2022, 05:19 PM UTC
Resolved
Jun 23, 2022, 06:26 PM UTC
Duration
1h 7m
Detected by Pingoru
Jun 23, 2022, 05:19 PM UTC

Update timeline

  1. investigating Jun 23, 2022, 05:19 PM UTC

    We are currently investigating this issue.

  2. identified Jun 23, 2022, 05:40 PM UTC

    The issue has been identified and a fix is being implemented.

  3. resolved Jun 23, 2022, 06:26 PM UTC

    We've mitigated the issue and new streams data is being collected as of 10:30 PST. There is a gap from around 9:30 PST to 10:30 PST for many streams. You may have false positive or negative alerts for this period. As a workaround, if you are using microsatellites you can see equivalent data during this time in notebooks or dashboards by querying the spans data. If you create a notebook for this span data then a snapshot of the data will be retained for longer (see https://docs.lightstep.com/docs/use-notebooks#data-retention-in-notebooks).