imgix incident

Delay in Purge requests

Minor Resolved View vendor source →

imgix experienced a minor incident on December 16, 2024 affecting Purging, lasting 6h 41m. The incident has been resolved; the full update timeline is below.

Started
Dec 16, 2024, 06:21 AM UTC
Resolved
Dec 16, 2024, 01:03 PM UTC
Duration
6h 41m
Detected by Pingoru
Dec 16, 2024, 06:21 AM UTC

Affected components

Purging

Update timeline

  1. investigating Dec 16, 2024, 06:21 AM UTC

    We have identified an issue with our purging service, causing new purge requests to be delayed in execution. (10mins+) Rendering services remain unaffected.

  2. identified Dec 16, 2024, 06:42 AM UTC

    The issue has been identified and we are working on a fix. To speed up processing of queued purge requests, we will have to temporarily disable purge requests for images that use any of the following AI-parameters: - bg-replace - compositions (any two or more ai features composed together, like bg-remove=true&upscale=true)

  3. identified Dec 16, 2024, 07:01 AM UTC

    Purge requests for images that use any of the below AI-parameters have been restored, but we are still observing longer purge times with a high queue. - bg-replace - compositions (any two or more ai features composed together, like bg-remove=true&upscale=true) We are looking at different approaches and will update accordingly.

  4. monitoring Dec 16, 2024, 09:02 AM UTC

    A fix has been implemented and new purge requests should again complete within expected times. We are continuing to monitor the situation.

  5. monitoring Dec 16, 2024, 01:02 PM UTC

    We are continuing to monitor for any further issues.

  6. resolved Dec 16, 2024, 01:03 PM UTC

    The purge queue and purge time has been stable since the last provided update.