Cockroach Labs incident

Dedicated Cluster Operations Errors

Major Resolved View vendor source →

Cockroach Labs experienced a major incident on July 18, 2024 affecting CockroachDB Basic/Standard and CockroachDB Advanced and 1 more component, lasting 12h 49m. The incident has been resolved; the full update timeline is below.

Started
Jul 18, 2024, 01:56 AM UTC
Resolved
Jul 18, 2024, 02:45 PM UTC
Duration
12h 49m
Detected by Pingoru
Jul 18, 2024, 01:56 AM UTC

Affected components

CockroachDB Basic/StandardCockroachDB AdvancedCockroachDB Cloud Console

Update timeline

  1. identified Jul 18, 2024, 02:22 AM UTC

    We are investigating an issue that is preventing CockroachDB Cloud Dedicated cluster creation and edit operations from running successfully.

  2. identified Jul 18, 2024, 02:34 AM UTC

    We are continuing to work on a fix for this issue.

  3. identified Jul 18, 2024, 03:04 AM UTC

    We are continuing to work on a fix for this issue.

  4. identified Jul 18, 2024, 03:16 AM UTC

    We have further identified that this issue may impact pages within the Cloud Console that connect to Serverless and Dedicated clusters. SQL connections to both Serverless and Dedicated clusters are working normally. We are continuing to investigate the cause of this outage and working towards a solution.

  5. identified Jul 18, 2024, 03:41 AM UTC

    We are continuing to work on a fix for this issue.

  6. monitoring Jul 18, 2024, 04:20 AM UTC

    We have resolved the underlying cause of the outages, and are monitoring to ensure the system remains operational.

  7. resolved Jul 18, 2024, 02:45 PM UTC

    Cluster operations and Cloud Console pages are restored to normal working order.