implio experienced a major incident on March 17, 2023 affecting implio core, lasting 1h 40m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Mar 17, 2023, 05:47 PM UTC
We are currently experiencing delays in processing items sent to Implio. This partial outage started at on March 17 at 17:42 CET. We are trying to resolve the issue as soon as possible.
- identified Mar 17, 2023, 06:39 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Mar 17, 2023, 07:04 PM UTC
The issue is fixed. The backlog of items has been processed, we're still monitoring.
- resolved Mar 17, 2023, 07:28 PM UTC
This incident has been resolved.
- postmortem Mar 20, 2023, 04:05 PM UTC
This incident was the result of a sudden burst of image traffic which exhausted resources and created a backlog of items. Auto-scaling didn’t kick in as it should have, causing some extra delay. To avoid more incidents like this in the future, we’ll be performing an upgrade today, March 20, 2023, at 18:00 GMT. There will be a short service interruption \(5-10 minutes approximately\) during which Implio will be unavailable. We’ll report this scheduled maintenance separately.