Starburst Galaxy incident

Data Processing Delays - Reporting Tools Affected

Resolved after 1 hour 44 minutes, affecting Starburst Galaxy UI, on August 22, 2024.

monitoring Aug 22, 2024, 07:47 PM UTC

We are continuing to monitor for any further issues.

Started
Aug 22, 2024, 06:05 PM UTC
Resolved
Aug 22, 2024, 07:49 PM UTC
Duration
1h 44m
Detected by Pingoru
Aug 22, 2024, 06:05 PM UTC

Affected components

Starburst Galaxy UI

Update timeline

  1. investigating Aug 22, 2024, 06:05 PM UTC

    We are aware of a problem with query history, where new queries are slow to appear on the list and completed queries appear as RUNNING. We have restarted a faulty K8s node that caused this and expect the backlog to clear in the next hour. The problem was first noticed around 1:30pm EDT. No data has been lost, only delayed to show up in the UI.

  2. monitoring Aug 22, 2024, 06:05 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. monitoring Aug 22, 2024, 07:08 PM UTC

    The query-history ingest process has caught up. The information in the UI should be up-to-date now.

  4. monitoring Aug 22, 2024, 07:47 PM UTC

    We are continuing to monitor for any further issues.

  5. resolved Aug 22, 2024, 07:49 PM UTC

    The query-history ingest has now caught up. All systems are operating normally.

Your product runs on more than Starburst Galaxy

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →