TeamDynamix incident

Webhook events backed up

Minor Resolved View vendor source →

TeamDynamix experienced a minor incident on June 5, 2024 affecting Webhooks and Webhooks, lasting 1h 24m. The incident has been resolved; the full update timeline is below.

Started
Jun 05, 2024, 06:45 PM UTC
Resolved
Jun 05, 2024, 08:10 PM UTC
Duration
1h 24m
Detected by Pingoru
Jun 05, 2024, 06:45 PM UTC

Affected components

WebhooksWebhooks

Update timeline

  1. identified Jun 05, 2024, 06:45 PM UTC

    We are experiencing a longer than normal level of webhook event processing times due to an excessive backlog of webhook requests. The system is chewing through the backlog of queued events, and we will scale as appropriate until everything is caught up again.

  2. resolved Jun 05, 2024, 08:10 PM UTC

    Webhook backlogged event requests were fully caught up again by about 2:45 ET.