Vusion experienced a major incident on November 11, 2022 affecting VUSION Cloud API - Europe, lasting 1h 47m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Nov 11, 2022, 12:30 AM UTC
Dear customers, Since roughly 11:45 PM UTC, we are experiencing issues processing incoming calls in Europe region. The root cause is coming from an Azure outage for which we are expected a feedback. Our Cloud Engineers are now triggering a work-around procedure. We apologize for the inconvenience and we will inform you as soon as possible. Thank you for your understanding
- monitoring Nov 11, 2022, 12:44 AM UTC
Dear customers, Our Cloud Engineer have mitigated the situation and all incoming calls are received as expected. We are now working on ensuring core operations, such as transmissions. The traceability of events may be degraded.
- monitoring Nov 11, 2022, 01:58 AM UTC
Dear customers, Our Cloud engineers have now mitigated the situation . Since 01:30 AM UTC, all core operations, such as transmissions, are now working as expected. Traceability is up to date. Since 01:50 AM UTC, all operations have resumed standard operations. We keep monitoring and are expecting feedback from Microsoft Azure.
- resolved Nov 11, 2022, 02:18 AM UTC
Dear customers, Our Cloud engineers have mitigated the situation, thanks to our secondary capacities, and the operations are now fully operational. Events and statuses are up to date and no data have been lost. Calls such as item inputs or matchings, which took place between the 10th of Nov. 11:34 PM UTC and the 11th 00:39 AM UTC and which got 500 status code, may need to be resent, if they have not been already. We are awaiting a root cause analysis from Microsoft Azure regarding this incident. We will also work in improving our resilience from such incidence and a post mortem will be published in the following weeks. On behalf of SES-imagotag, the whole Cloud Ops team sincerely apologize for the inconvenience. Please believe that we are continuously doing our best to improve our platform and our processes.