Vitally incident

Playbook Execution Delays

Minor Resolved View vendor source →

Vitally experienced a minor incident on January 3, 2025 affecting Product, lasting 3d 5h. The incident has been resolved; the full update timeline is below.

Started
Jan 03, 2025, 03:12 PM UTC
Resolved
Jan 06, 2025, 08:16 PM UTC
Duration
3d 5h
Detected by Pingoru
Jan 03, 2025, 03:12 PM UTC

Affected components

Product

Update timeline

  1. investigating Jan 03, 2025, 03:12 PM UTC

    Our playbook execution infrastructure is experiencing an unusually high number of jobs in our EU data centers, causing playbook executions to be delayed up to several hours. The delays started approximately 8 hours ago. No data has been lost, and playbook execution is almost caught up.

  2. monitoring Jan 03, 2025, 11:01 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Jan 06, 2025, 08:16 PM UTC

    This incident has been resolved.