dataforest incident

Increased Disk Latency in Ceph Cluster

Resolved after 5 hours 59 minutes, affecting Ceph Cluster and Virtual Servers, on October 22, 2026.

monitoring Oct 22, 2026, 11:15 AM UTC

Over the past few hours, we have observed increased disk latency in our Ceph cluster, affecting storage performance in both the dataforest cloud and the Avoro cluster. We have identified a faulty disk and taken it out of service. If you continue to observe unusual disk latency or performance issues, please report them to [email protected]. We are not aware of any resulting disruptions to production services or outages. However, customers may have noticed the increased latency in their own monitoring, so we are sharing this update to explain what happened. We will also improve our monitoring to detect similar issues sooner.

Started
Oct 22, 2026, 11:15 AM UTC
Resolved
Oct 22, 2026, 05:15 PM UTC
Duration
5h 59m
Detected by Pingoru
Oct 22, 2026, 11:15 AM UTC

Affected components

Ceph ClusterVirtual Servers

Update timeline

  1. monitoring Oct 22, 2026, 11:15 AM UTC

    Over the past few hours, we have observed increased disk latency in our Ceph cluster, affecting storage performance in both the dataforest cloud and the Avoro cluster. We have identified a faulty disk and taken it out of service. If you continue to observe unusual disk latency or performance issues, please report them to [email protected]. We are not aware of any resulting disruptions to production services or outages. However, customers may have noticed the increased latency in their own monitoring, so we are sharing this update to explain what happened. We will also improve our monitoring to detect similar issues sooner.

  2. resolved Oct 22, 2026, 05:15 PM UTC

    No more issues were observed. Therefore we close this incident.

Your product runs on more than dataforest

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →