Voyado incident

Engage - queue/buildup of some contact events

Resolved after 1 day, affecting Automations and Other, on October 5, 2026.

postmortem Oct 13, 2026, 07:52 AM UTC

## Summary Between 5 October and 6 October 2026, processing of some events in Voyado Engage was delayed. The cause was an internal update to one of our background processes, which unexpectedly triggered a large amount of extra processing. The issue was limited to this process and has been corrected. ## Customer Impact Automations triggered by contact interactions ran later than normal. Webhooks for contact, consent and preferences changes were delayed as well. ## Root Cause and Mitigation A safeguard in the update did not work as intended, so existing data was processed again as if it were new. This happened on two occasions, 5 and 6 October. Our engineering teams stopped the process, cleared the extra processing and confirmed that everything was back to normal. ## Next Steps We are adding stronger safeguards and checks for this type of update, as well as earlier alerts so we can react faster if something similar happens. We apologize for the disruption and appreciate your patience.

Started
Oct 05, 2026, 01:16 PM UTC
Resolved
Oct 06, 2026, 02:09 PM UTC
Duration
1d
Detected by Pingoru
Oct 05, 2026, 01:16 PM UTC

Affected components

AutomationsOther

Update timeline

  1. investigating Oct 05, 2026, 01:16 PM UTC

    There is currently a buildup of messages queued up on one of our processes, this is causing delays to automations triggered by interactions as well as webhooks related to contact events. It is being investigated.

  2. identified Oct 05, 2026, 02:15 PM UTC

    We have identified a likely cause and taken steps to address it. We are now monitoring the results and will continue working on the issue until we can confirm it has been resolved.

  3. monitoring Oct 05, 2026, 03:18 PM UTC

    We are seeing continued progress, with delays gradually decreasing. Delays remain, but we expect the service to recover during the evening. We will continue to monitor the service closely as it recovers.

  4. monitoring Oct 06, 2026, 09:08 AM UTC

    Some delays remain. We currently expect the service to return to normal around 13:00 CEST and will continue to monitor it closely.

  5. monitoring Oct 06, 2026, 12:47 PM UTC

    Unfortunately, some delays remain, but they continue to decrease. We currently expect the service to return to normal in about 30 minutes.

  6. resolved Oct 06, 2026, 02:09 PM UTC

    This incident has been resolved. We have not observed any further delays since around 15:15 CEST.

  7. postmortem Oct 13, 2026, 07:52 AM UTC

    ## Summary Between 5 October and 6 October 2026, processing of some events in Voyado Engage was delayed. The cause was an internal update to one of our background processes, which unexpectedly triggered a large amount of extra processing. The issue was limited to this process and has been corrected. ## Customer Impact Automations triggered by contact interactions ran later than normal. Webhooks for contact, consent and preferences changes were delayed as well. ## Root Cause and Mitigation A safeguard in the update did not work as intended, so existing data was processed again as if it were new. This happened on two occasions, 5 and 6 October. Our engineering teams stopped the process, cleared the extra processing and confirmed that everything was back to normal. ## Next Steps We are adding stronger safeguards and checks for this type of update, as well as earlier alerts so we can react faster if something similar happens. We apologize for the disruption and appreciate your patience.

Your product runs on more than Voyado

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →