Grafana incident

Elevated 429 Errors Impacting Metrics Querying Across Multiple Regions

Critical Resolved View vendor source →

Grafana experienced a critical incident on April 20, 2026 affecting AWS Australia - prod-ap-southeast-2: Querying and AWS Australia - prod-ap-southeast-2: Ingestion and 1 more component, lasting 21m. The incident has been resolved; the full update timeline is below.

Started
Apr 20, 2026, 02:09 PM UTC
Resolved
Apr 20, 2026, 02:30 PM UTC
Duration
21m
Detected by Pingoru
Apr 20, 2026, 02:09 PM UTC

Affected components

AWS Australia - prod-ap-southeast-2: QueryingAWS Australia - prod-ap-southeast-2: IngestionAWS Brazil - prod-sa-east-1: QueryingAWS Brazil - prod-sa-east-1: IngestionAWS Canada - prod-ca-east-0: QueryingAWS Canada - prod-ca-east-0: IngestionAWS Germany - prod-eu-west-2: QueryingAWS Germany - prod-eu-west-2: IngestionAWS UAE - prod-me-central-1: QueryingAWS UAE - prod-me-central-1: Ingestion

Update timeline

  1. investigating Apr 20, 2026, 02:09 PM UTC

    We are currently experiencing a major incident causing elevated 429 (rate limit) errors across multiple regions, primarily impacting metrics querying. This is a high-priority issue, and our engineering team is actively engaged and working urgently to identify the root cause and restore full service as quickly as possible. Customers may experience widespread failures or delays when querying metrics during this time. We understand the significant impact this may have and will continue to provide updates as more information becomes available.

  2. investigating Apr 20, 2026, 02:21 PM UTC

    The issue is now confirmed to be widespread, affecting Prometheus across all regions. Customers may continue to experience elevated 429 (rate limit) errors, particularly when querying metrics, with failures or inconsistent responses possible. Our engineering team remains fully engaged and is actively working on mitigation and resolution efforts with the highest priority.

  3. resolved Apr 20, 2026, 02:30 PM UTC

    This incident has been resolved. Thank you for your patience.