Calibre incident

Some tests failing to run in selected regions

Major Resolved View vendor source →

Calibre experienced a major incident on May 21, 2020 affecting Sydney and São Paulo and 1 more component, lasting 46m. The incident has been resolved; the full update timeline is below.

Started
May 21, 2020, 08:44 AM UTC
Resolved
May 21, 2020, 09:30 AM UTC
Duration
46m
Detected by Pingoru
May 21, 2020, 08:44 AM UTC

Affected components

SydneySão PauloLondonMumbaiNorthern CaliforniaOregon

Update timeline

  1. investigating May 21, 2020, 07:20 AM UTC

    We are currently investigating this issue.

  2. investigating May 21, 2020, 07:21 AM UTC

    We are continuing to investigate this issue.

  3. investigating May 21, 2020, 07:22 AM UTC

    We are continuing to investigate this issue.

  4. identified May 21, 2020, 08:20 AM UTC

    We're working with our compute provider to resolve this issue.

  5. identified May 21, 2020, 08:37 AM UTC

    We are continuing to work on a fix for this issue.

  6. identified May 21, 2020, 08:44 AM UTC

    We are currently investigating test failures in selected regions. You might experience some Snapshots being marked as "failed". We’re working with our compute provider to resolve this issue. We will provide more information as soon as it’s available.

  7. resolved May 21, 2020, 09:30 AM UTC

    We have identified and addressed the issue behind some tests in some regions resulting in failures. All tests should now be running successfully. Past tests that failed will be re-run.