Crazy Ant Labs incident

Job Completion Delays

Resolved after 5 days 9 hours, affecting API Requests and Heroku, on December 5, 2022.

identified Dec 05, 2022, 11:03 PM UTC

We have identified a small portion of job completion delays (average of around 60 minutes) which are impacting some of our customers. The culprit is significant delays of Heroku Webhooks which we use in order to determine Dyno completions. We are actively working with Heroku's engineering team to determine, and resolve, the cause of the delay. Important: The issue has no impact on triggering new jobs to start, but it is only impacting our ability to indicate job completion (either successful or failed).

Started
Dec 05, 2022, 11:03 PM UTC
Resolved
Dec 11, 2022, 08:43 AM UTC
Duration
5d 9h
Detected by Pingoru
Dec 05, 2022, 11:03 PM UTC

Affected components

API RequestsHeroku

Update timeline

  1. identified Dec 05, 2022, 11:03 PM UTC

    We have identified a small portion of job completion delays (average of around 60 minutes) which are impacting some of our customers. The culprit is significant delays of Heroku Webhooks which we use in order to determine Dyno completions. We are actively working with Heroku's engineering team to determine, and resolve, the cause of the delay. Important: The issue has no impact on triggering new jobs to start, but it is only impacting our ability to indicate job completion (either successful or failed).

  2. resolved Dec 11, 2022, 08:43 AM UTC

    This incident has been resolved.

Your product runs on more than Crazy Ant Labs

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →