Crazy Ant Labs incident

Issue with delayed delivery of events

Resolved after 2 hours 11 minutes, affecting Notifications and Slack and 1 more, on April 29, 2025.

monitoring Apr 29, 2025, 08:34 PM UTC

The events backlog is still being caught up.

Started
Apr 29, 2025, 06:30 PM UTC
Resolved
Apr 29, 2025, 08:41 PM UTC
Duration
2h 11m
Detected by Pingoru
Apr 29, 2025, 06:30 PM UTC

Affected components

NotificationsSlackWebhooksAmazon S3

Update timeline

  1. investigating Apr 29, 2025, 06:30 PM UTC

    We identified an issue with Activity To Go subscription events. Users may experience a delay receiving Heroku events. Our team is investigating the root cause.

  2. identified Apr 29, 2025, 06:32 PM UTC

    Our team has identified an issue with authenticating Heroku Webhook requests which triggers events. The team is working on a fix.

  3. identified Apr 29, 2025, 07:58 PM UTC

    The team applied a fix and event deliveries backlog are being delivered.

  4. monitoring Apr 29, 2025, 08:34 PM UTC

    The events backlog is still being caught up.

  5. resolved Apr 29, 2025, 08:41 PM UTC

    This incident has been resolved.

Your product runs on more than Crazy Ant Labs

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →