Catalyst Cloud incident

Service API partial outage in the nz-por-1 region

Catalyst Cloud experienced a major incident on December 4, 2024 affecting APIs (nz-por-1) and Compute (nz-por-1) and 1 more component, lasting 3h 12m. The incident has been resolved; the full update timeline is below.

Started: Dec 04, 2024, 11:18 PM UTC
Resolved: Dec 05, 2024, 02:31 AM UTC
Duration: 3h 12m
Detected by Pingoru: Dec 04, 2024, 11:18 PM UTC

Affected components

APIs (nz-por-1)Compute (nz-por-1)Block storage (nz-por-1)Network (nz-por-1)Load balancer (nz-por-1)Cloud orchestration (nz-por-1)Kubernetes (nz-por-1)Database service

Update timeline

investigating Dec 04, 2024, 11:18 PM UTC

We are currently investigating this issue.
investigating Dec 04, 2024, 11:30 PM UTC

The following API services are affected: * Compute * Networking * Block Storage * Load Balancers * Cloud Orchestration * Kubernetes cluster creations/updates/deletions (existing clusters are operating normally) Workloads are continuing to operate normally; however you may be unable to make any changes to workloads at this time. The following API services are operating normally: * Identity & Access Management * Object Storage
monitoring Dec 05, 2024, 12:08 AM UTC

A fix has been implemented and we are monitoring the results.
resolved Dec 05, 2024, 02:31 AM UTC

This incident has been resolved.