Grafana incident

Elevated Errors Ingesting Metrics in AWS US East (VA)

Resolved after 6 hours 56 minutes, affecting AWS US East (VA) - prod-us-east-3, on October 12, 2026.

resolved Oct 12, 2026, 04:42 PM UTC

From 09:45 UTC on 2026-10-12, customers in AWS US East (VA) experienced failed or delayed metric writes to Grafana Cloud Metrics, which may have also affected Frontend Observability and Synthetic Monitoring data in that region. This has been fully resolved and all services are operating normally again.

Started
Oct 12, 2026, 09:45 AM UTC
Resolved
Oct 12, 2026, 04:42 PM UTC
Duration
6h 56m
Detected by Pingoru
Oct 12, 2026, 09:45 AM UTC

Affected components

AWS US East (VA) - prod-us-east-3

Update timeline

  1. investigating Oct 12, 2026, 09:45 AM UTC

    We are investigating an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA). Customers may see failed or delayed writes. Next update by 10:15 UTC.

  2. investigating Oct 12, 2026, 10:08 AM UTC

    We are continuing to investigate an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA). Customers may see failed or delayed writes. Next update by 11:00 UTC.

  3. investigating Oct 12, 2026, 10:55 AM UTC

    We are continuing to investigate an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA). Customers may see failed or delayed writes to Grafana Cloud Metrics, this may also impact Metrics written by Frontend Observability and/or Synthetic Monitoring. Next update by 12:00 UTC.

  4. identified Oct 12, 2026, 11:56 AM UTC

    We have identified the cause of an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA) - prod-us-east-3. Customers may see failed or delayed writes to Grafana Cloud Metrics, this may also impact Metrics written by Frontend Observability and/or Synthetic Monitoring. We are continuing to work on mitigations and are monitoring the impact to Grafana Cloud Metrics. Next update by 13:00 UTC.

  5. identified Oct 12, 2026, 12:53 PM UTC

    We have identified the cause of an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA) - prod-us-east-3. Customers may see failed or delayed writes to Grafana Cloud Metrics, this may also impact Metrics written by Frontend Observability and/or Synthetic Monitoring. We are continuing to work on mitigations and are monitoring the impact to Grafana Cloud Metrics. Next update by 14:00 UTC.

  6. identified Oct 12, 2026, 02:01 PM UTC

    We have isolated infrastructure suspected of contributing to the metrics ingestion issue in AWS US East (VA) - prod-us-east-3. We are validating recovery and completing mitigation steps. Customers may continue to experience failed or delayed metric writes while this work continues.

  7. identified Oct 12, 2026, 03:01 PM UTC

    We have isolated infrastructure suspected of contributing to the metrics ingestion issue in AWS US East (VA) - prod-us-east-3. We are validating recovery and completing mitigation steps. Customers may continue to experience failed or delayed metric writes while this work continues.

  8. resolved Oct 12, 2026, 04:42 PM UTC

    From 09:45 UTC on 2026-10-12, customers in AWS US East (VA) experienced failed or delayed metric writes to Grafana Cloud Metrics, which may have also affected Frontend Observability and Synthetic Monitoring data in that region. This has been fully resolved and all services are operating normally again.

Your product runs on more than Grafana

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →