Lightstep incident

Degraded log ingestion and partial query results

Notice Resolved View vendor source →

Lightstep experienced a notice incident on March 14, 2024 affecting US - Logs and US - Logs Search, lasting 54m. The incident has been resolved; the full update timeline is below.

Started
Mar 14, 2024, 07:58 PM UTC
Resolved
Mar 14, 2024, 08:53 PM UTC
Duration
54m
Detected by Pingoru
Mar 14, 2024, 07:58 PM UTC

Affected components

US - LogsUS - Logs Search

Update timeline

  1. investigating Mar 14, 2024, 07:58 PM UTC

    Some customers are reporting partial results for logging queries. We are currently investigating this along side degraded performance of log ingestion via the OTLP format.

  2. identified Mar 14, 2024, 08:22 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Mar 14, 2024, 08:23 PM UTC

    We are seeing log backfill into the platform and queries returning expected results. We will continue to monitor the situation.

  4. resolved Mar 14, 2024, 08:53 PM UTC

    This incident has been resolved.