VideoAsk incident

Incident with Email & Dashboard notifications (webhooks also affected)

Major Resolved View vendor source →

VideoAsk experienced a major incident on April 9, 2021 affecting API, lasting 2h 31m. The incident has been resolved; the full update timeline is below.

Started
Apr 09, 2021, 08:24 PM UTC
Resolved
Apr 09, 2021, 10:55 PM UTC
Duration
2h 31m
Detected by Pingoru
Apr 09, 2021, 08:24 PM UTC

Affected components

API

Update timeline

  1. investigating Apr 09, 2021, 08:24 PM UTC

    We're reporting an issue across the platform which is affecting all notification systems. Data is being collected, however, dashboard, email notifications as well as webhooks are not being fired. (Data will be showing up in your individual inboxes if you select the 'all people' filter)

  2. identified Apr 09, 2021, 08:55 PM UTC

    We've identified an issue with our 'workers' service which fires off all relevant notifications when new responses are received. The 'workers' service has been reinitiated however we're still experiencing issues. You may see intermittent interactions come through.

  3. monitoring Apr 09, 2021, 10:37 PM UTC

    We're starting to see the 'workers' service coming back to normal and users should see notifications coming through in real-time. We're continuing to monitor the situation.

  4. resolved Apr 09, 2021, 10:55 PM UTC

    The 'workers' service is now fully operational and all notifications are coming through normally. We apologize for any inconveniences the delays have caused today.