Datacake incident

Delay in outgoing webhooks

Minor Resolved View vendor source →

Datacake experienced a minor incident on January 24, 2024, lasting 3h 2m. The incident has been resolved; the full update timeline is below.

Started
Jan 24, 2024, 08:40 AM UTC
Resolved
Jan 24, 2024, 11:42 AM UTC
Duration
3h 2m
Detected by Pingoru
Jan 24, 2024, 08:40 AM UTC

Update timeline

  1. investigating Jan 24, 2024, 08:40 AM UTC

    We're addressing increased load on our systems responsible for processing outgoing webhook calls, which may result in some delays. We apologize for any inconvenience and are working to resolve this issue promptly..

  2. identified Jan 24, 2024, 11:22 AM UTC

    We have identified the root cause of the issue and are actively developing a solution. We appreciate your patience as we work to resolve this matter..

  3. resolved Jan 24, 2024, 11:42 AM UTC

    The issue has been mitigated by pinpointing webhooks that were timing out and contributing to the delays. We've temporarily increased the number of workers to manage the workload more effectively. Meanwhile, we are formulating a sustainable fix to prevent recurrence of this issue. Thank you for your understanding as we enhance our systems..