Astronomer incident

Some clusters are unable to start new KPO tasks

Critical Resolved View vendor source →

Astronomer experienced a critical incident on July 3, 2025 affecting Scheduling and Running DAGs and Tasks and Scheduling and Running DAGs and Tasks, lasting 2h 51m. The incident has been resolved; the full update timeline is below.

Started
Jul 03, 2025, 11:19 PM UTC
Resolved
Jul 04, 2025, 02:10 AM UTC
Duration
2h 51m
Detected by Pingoru
Jul 03, 2025, 11:19 PM UTC

Affected components

Scheduling and Running DAGs and TasksScheduling and Running DAGs and Tasks

Update timeline

  1. investigating Jul 03, 2025, 11:19 PM UTC

    Some clusters that were updated today will fail to run any KPO tasks

  2. identified Jul 03, 2025, 11:52 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Jul 04, 2025, 01:06 AM UTC

    A fix has been implemented. We are currently monitoring the results.

  4. resolved Jul 04, 2025, 02:10 AM UTC

    This incident has been resolved.