Prismatic incident

Increased error rates in Execution Pipeline

Major Resolved View vendor source →

Prismatic experienced a major incident on May 15, 2025 affecting Integration Runner, lasting 41m. The incident has been resolved; the full update timeline is below.

Started
May 15, 2025, 09:10 PM UTC
Resolved
May 15, 2025, 09:52 PM UTC
Duration
41m
Detected by Pingoru
May 15, 2025, 09:10 PM UTC

Affected components

Integration Runner

Update timeline

  1. investigating May 15, 2025, 09:10 PM UTC

    At approximately 1:47 PST the Prismatic team received an alert for an increase in error rates in the execution pipeline. We have started a rollback procedure that we expect will resolve the issue, and then we will address the underlying root cause.

  2. investigating May 15, 2025, 09:34 PM UTC

    We have completed rollback of all stacks the execution pipeline is back to fully operational status. We will continue our investigation to determine root cause and will keep this incident updated as we progress.

  3. investigating May 15, 2025, 09:34 PM UTC

    We are continuing to investigate this issue.

  4. investigating May 15, 2025, 09:45 PM UTC

    We have identified the root issue and are working on a fix.

  5. resolved May 15, 2025, 09:52 PM UTC

    This incident has been resolved.