Vusion incident

[Europe] Incoming calls outage

Critical Resolved View vendor source →

Vusion experienced a critical incident on October 13, 2022 affecting VUSION Cloud API - Europe, lasting 4h 39m. The incident has been resolved; the full update timeline is below.

Started
Oct 13, 2022, 04:27 AM UTC
Resolved
Oct 13, 2022, 09:06 AM UTC
Duration
4h 39m
Detected by Pingoru
Oct 13, 2022, 04:27 AM UTC

Affected components

VUSION Cloud API - Europe

Update timeline

  1. investigating Oct 13, 2022, 04:27 AM UTC

    Dear customers, Since 4:55 UTC AM, we are experiencing issues processing incoming calls in Europe region. Our engineers are investigating to identify the cause. It seems to root from Azure outage.

  2. identified Oct 13, 2022, 04:39 AM UTC

    The issue has been identified and we are mitigating to ensure reception of messages.

  3. monitoring Oct 13, 2022, 05:11 AM UTC

    Our Cloud engineers have switched the faulty unit to our secondary region. All incoming calls are now successfully processed. The traceability of events may be degraded.

  4. resolved Oct 13, 2022, 09:06 AM UTC

    Dear customers, We have switched to secondary units and the operations are now fully operational. Events and statuses are up to date and no data have been lost. Calls such as item inputs or matchings, which took place between 03:50 UTC and 04:29 and which got 500 status code, may need to be resent, if they have not been already. We are awaiting a root cause analysis from Microsoft Azure regarding this incident. We will also work in improving our resilience from such incidence. On behalf of SES-imagotag, the whole Cloud Ops team sincerely apologize for the inconvenience. Please believe that we are continuously doing our best to improve our platform and our processes.