Grafana incident

Mimir read errors and high latency in prod-eu-west-0

Resolved after 20 hours 43 minutes, affecting GCP Belgium - prod-eu-west-0: Querying and GCP Belgium - prod-eu-west-0: Ingestion, on June 29, 2026.

resolved Jun 30, 2026, 08:20 AM UTC

Since the mitigation has been applied, we have not seen the errors return. At this point, we are considering the incident resolved.

Started
Jun 29, 2026, 11:37 AM UTC
Resolved
Jun 30, 2026, 08:20 AM UTC
Duration
20h 43m
Detected by Pingoru
Jun 29, 2026, 11:37 AM UTC

Affected components

GCP Belgium - prod-eu-west-0: QueryingGCP Belgium - prod-eu-west-0: Ingestion

Update timeline

  1. investigating Jun 29, 2026, 11:37 AM UTC

    We are currently investigating an issue with Mimir in prod-eu-west-0 we are seeing read errors and high latency. This incident is currently ongoing. The errors are recovering but we are currently looking into the route cause of this.

  2. investigating Jun 29, 2026, 01:52 PM UTC

    The errors are recovering, and we are still looking into the root cause of this.

  3. investigating Jun 29, 2026, 03:37 PM UTC

    The errors and latency have now recovered, we continue investigating the root cause.

  4. identified Jun 29, 2026, 05:47 PM UTC

    We've identified a possible cause, and a mitigation is in place to prevent further occurrences.

  5. resolved Jun 30, 2026, 08:20 AM UTC

    Since the mitigation has been applied, we have not seen the errors return. At this point, we are considering the incident resolved.

Your product runs on more than Grafana

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →