Vero incident

Delays in webhook processing

Notice Resolved View vendor source →

Vero experienced a notice incident on July 10, 2024 affecting Reports data availability (Vero default and Mailgun integrations) and Reports data availability (Sendgrid and other non-Mailgun integrations), lasting 1d 15h. The incident has been resolved; the full update timeline is below.

Started
Jul 10, 2024, 07:51 AM UTC
Resolved
Jul 11, 2024, 11:33 PM UTC
Duration
1d 15h
Detected by Pingoru
Jul 10, 2024, 07:51 AM UTC

Affected components

Reports data availability (Vero default and Mailgun integrations)Reports data availability (Sendgrid and other non-Mailgun integrations)

Update timeline

  1. investigating Jul 10, 2024, 07:51 AM UTC

    We are currently investigating this issue.

  2. identified Jul 10, 2024, 12:24 PM UTC

    We have identified the cause of the issue.

  3. monitoring Jul 10, 2024, 10:14 PM UTC

    We have been monitoring the situation since identifying and addressing the issue earlier today. We are still working through the backlog of webhooks and will continue to monitor until we are back in real time.

  4. monitoring Jul 11, 2024, 01:23 AM UTC

    We have now processed 98% of the backlog and are working through the final 2%. We will leave this issue as "Monitoring" until we've fully cleared the backlog.

  5. resolved Jul 11, 2024, 11:33 PM UTC

    This incident has been resolved.