Presslabs incident

US Cluster Hardware Incident

Major Resolved View vendor source →

Presslabs experienced a major incident on April 5, 2018, lasting 3h 3m. The incident has been resolved; the full update timeline is below.

Started
Apr 05, 2018, 11:53 AM UTC
Resolved
Apr 05, 2018, 02:56 PM UTC
Duration
3h 3m
Detected by Pingoru
Apr 05, 2018, 11:53 AM UTC

Update timeline

  1. investigating Apr 05, 2018, 11:53 AM UTC

    We have just encountered a hardware incident on our main US cluster. We are working to get everything back online as soon as possible. wp-admin areas are affected and might be unavailable as we are working on getting everything back online.

  2. identified Apr 05, 2018, 12:11 PM UTC

    The hardware issue has been resolved. The MySQL cluster is fully operational again and we are now restarting all instances. wp-admin areas should come back online.

  3. monitoring Apr 05, 2018, 12:17 PM UTC

    All instances and backends are fully operational. We have restored normal cache protocol. Please note that during this time, your public sites were cached and not affected. We'll continue to monitor for a few more hours to ensure no more issues arises.

  4. resolved Apr 05, 2018, 02:56 PM UTC

    We have not seen any other significant incidents, and the servers are running nominally. This incident is now closed. Thank you!