Datacake incident

Delay in outgoing webhooks

Minor Resolved View vendor source →

Datacake experienced a minor incident on January 24, 2024, lasting —. The incident has been resolved; the full update timeline is below.

Started
Jan 24, 2024, 08:40 AM UTC
Resolved
Jan 24, 2024, 08:40 AM UTC
Duration
Detected by Pingoru
Jan 24, 2024, 08:40 AM UTC

Update timeline

  1. resolved Jan 24, 2024, 08:40 AM UTC

    Type: Incident Duration: 3 hours and 2 minutes Affected Components: Outgoing Webhooks Jan 24, 08:40:00 GMT+0 - Investigating - We're addressing increased load on our systems responsible for processing outgoing webhook calls, which may result in some delays. We apologize for any inconvenience and are working to resolve this issue promptly. Jan 24, 11:22:52 GMT+0 - Identified - We have identified the root cause of the issue and are actively developing a solution. We appreciate your patience as we work to resolve this matter. Jan 24, 11:42:27 GMT+0 - Resolved - The issue has been mitigated by pinpointing webhooks that were timing out and contributing to the delays. We've temporarily increased the number of workers to manage the workload more effectively. Meanwhile, we are formulating a sustainable fix to prevent recurrence of this issue. Thank you for your understanding as we enhance our systems.