Cockroach Labs incident

Serverless Cluster Resource Limit Throttling

Major Resolved View vendor source →

Cockroach Labs experienced a major incident on August 2, 2023, lasting 3h 39m. The incident has been resolved; the full update timeline is below.

Started
Aug 02, 2023, 04:05 PM UTC
Resolved
Aug 02, 2023, 07:44 PM UTC
Duration
3h 39m
Detected by Pingoru
Aug 02, 2023, 04:05 PM UTC

Update timeline

  1. investigating Aug 02, 2023, 04:05 PM UTC

    Some Serverless clusters that have hit their resource limits are still being throttled even after limits have been increased. Currently only AWS eu-west-1 and ap-south-1 host clusters are impacted

  2. investigating Aug 02, 2023, 04:10 PM UTC

    Some Serverless clusters that have hit their resource limits are still being throttled even after limits have been increased.

  3. identified Aug 02, 2023, 07:02 PM UTC

    The scope of the impact has been limited to serverless clusters running AWS eu-west-1 and AWS ap-south-1. Clusters that have hit their resource limits will be throttled despite having their limits increased. One of two issues identified has been mitigated.

  4. resolved Aug 02, 2023, 07:44 PM UTC

    This issue has now been resolved. Users with clusters that were previously throttled will now see their changes to resource limits reflected.