Coda incident

Partial outage of pack requests from clients

Major Resolved View vendor source →

Coda experienced a major incident on February 26, 2023 affecting Packs, lasting 3h 47m. The incident has been resolved; the full update timeline is below.

Started
Feb 26, 2023, 05:23 PM UTC
Resolved
Feb 26, 2023, 09:10 PM UTC
Duration
3h 47m
Detected by Pingoru
Feb 26, 2023, 05:23 PM UTC

Affected components

Packs

Update timeline

  1. investigating Feb 26, 2023, 05:23 PM UTC

    We are aware of an issue that is causing some pack requests to fail when they are initiated from clients. We currently believe this may be an issue within HTTP/2 handling on AWS's CloudFront and we are working with AWS support to try to resolve the issue. We do not currently have a ETA for the issue to be resolved. A workaround for impacted documents can be to reload the document after a few minutes. Pack request results may then appear within the document.

  2. monitoring Feb 26, 2023, 08:38 PM UTC

    We've rolled out a workaround for the CloudFront issue and monitoring to see if it fixes the issue.

  3. resolved Feb 26, 2023, 09:10 PM UTC

    We've verified that the issue is resolved with our workaround in place.