Grafana incident

Service degradation on Logs Read path in AWS US West (us-west-0)

Resolved after 6 hours 13 minutes, affecting AWS US West - prod-us-west-0, on March 8, 2026.

resolved Mar 08, 2026, 08:31 PM UTC

We continue to observe a continued period of stability since 19:40 UTC. At this time, we are considering this issue resolved

Started
Mar 08, 2026, 02:17 PM UTC
Resolved
Mar 08, 2026, 08:31 PM UTC
Duration
6h 13m
Detected by Pingoru
Mar 08, 2026, 02:17 PM UTC

Affected components

AWS US West - prod-us-west-0

Update timeline

  1. investigating Mar 08, 2026, 02:17 PM UTC

    Our engineering team is investigating issues on the read path of Loki services on AWS US West since today aroun ~13:25UTC. These issues can cause timeouts and 5xx errors when query logs for customers on the cluster. The team is currently working to restore the service.

  2. monitoring Mar 08, 2026, 06:29 PM UTC

    Since 16:35 UTC we have experienced stability and services are recovering. We are actively monitoring and working to fully stabilize

  3. resolved Mar 08, 2026, 08:31 PM UTC

    We continue to observe a continued period of stability since 19:40 UTC. At this time, we are considering this issue resolved

Your product runs on more than Grafana

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →