Grafana incident

IRM Degraded Performance

Resolved after 9 hours 44 minutes, affecting GCP Belgium - prod-eu-west-0: Alertmanager and Rules Configuration API and GCP US Central - prod-us-central-0: Alertmanager and Rules Configuration API, on June 8, 2026.

monitoring Jun 08, 2026, 05:11 PM UTC

We've released a fix to the IRM app that should restore service for affected customers with issues related to labels. Thanks for your patience while investigating. We're continuing to monitor as we confirm the resolution in place.

Started
Jun 08, 2026, 10:45 AM UTC
Resolved
Jun 08, 2026, 08:30 PM UTC
Duration
9h 44m
Detected by Pingoru
Jun 08, 2026, 10:45 AM UTC

Affected components

GCP Belgium - prod-eu-west-0: Alertmanager and Rules Configuration APIGCP US Central - prod-us-central-0: Alertmanager and Rules Configuration API

Update timeline

  1. investigating Jun 08, 2026, 10:45 AM UTC

    We are experiencing access issues in IRM as there are elevated 500 API responses in prod-us-central-0.

  2. investigating Jun 08, 2026, 10:47 AM UTC

    We are continuing to investigate this issue.

  3. identified Jun 08, 2026, 11:15 AM UTC

    The issue has been identified and a fix is being implemented.

  4. identified Jun 08, 2026, 12:26 PM UTC

    We are continuing to work on a fix for this issue.

  5. identified Jun 08, 2026, 01:14 PM UTC

    The degraded performance is about labels, and we have seen this degradation in more regions.

  6. identified Jun 08, 2026, 03:21 PM UTC

    We are continuing to work on a fix for this. To further clarify, this issue is not about accessing IRM or alert ingestion/notification/delivery, but rather with handling labels.

  7. monitoring Jun 08, 2026, 05:11 PM UTC

    We've released a fix to the IRM app that should restore service for affected customers with issues related to labels. Thanks for your patience while investigating. We're continuing to monitor as we confirm the resolution in place.

  8. resolved Jun 08, 2026, 08:30 PM UTC

    This incident has been resolved.

Your product runs on more than Grafana

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →