GraphCDN experienced a major incident on February 28, 2024 affecting Purging API, lasting 22h 26m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 28, 2024, 03:41 PM UTC
We are currently looking into a potential issue with the Purging API not removing data from the cache. We are working with our infrastructure partners to investigate what is causing this.
- investigating Feb 28, 2024, 10:42 PM UTC
We continue to look into this with the Fastly team. We have narrowed this down to an issue with purging, in which all purges are considered soft purges if the cache configuration includes swr (stale-while-revalidate) values.
- investigating Feb 28, 2024, 11:44 PM UTC
Fastly has added an incident to their status page, available at https://www.fastlystatus.com/incident/376338 They are still investigating the issue and looking for a fix.
- monitoring Feb 29, 2024, 01:08 AM UTC
Fastly has begun rolling out a fix and is monitoring purges on their systems. The current ETA for the system-wide rollout is ~12 hours. As a (temporary) workaround, we recommend disabling `swr` for all cache rules. We will continue monitoring this incident on our end and update this status page as we get additional information from the team at Fastly.
- monitoring Feb 29, 2024, 01:33 PM UTC
The fix has been rolled out to all nodes and the Fastly team is monitoring purges across their systems.
- resolved Feb 29, 2024, 02:07 PM UTC
This incident has been resolved.