Optimism experienced a minor incident on May 18, 2024, lasting —. The incident has been resolved; the full update timeline is below.
Update timeline
- resolved May 18, 2024, 08:10 AM UTC
Type: Incident Duration: 17 days, 9 hours and 12 minutes Affected Components: Node Sync, Transaction Sequencing May 18, 08:10:00 GMT+0 - Investigating - We became aware of a slowdown in the unsafe head of our sequencer today at 09:10 UTC. This impacted other nodes in the network, presenting as an unsafe head stall for approximately 9 minutes. The performance issue resolved on its own after approximately 20 minutes. We are aware of the root cause and will be issuing further communications in due course. May 19, 13:31:59 GMT+0 - Investigating - We continue to see intermittent degraded performance on the sequencer's unsafe head. May 19, 14:07:01 GMT+0 - Monitoring - The unsafe head is currently performing as normal, however we may still see occasional slow unsafe heads as we roll out performance fixes to the network. We will continue to update this issue if extended periods of slow unsafe heads occur. No action is required from users. May 21, 23:44:48 GMT+0 - Monitoring - We observed another period (approximately 5 minutes) of slow blocks. Block production has resumed and we are continuing to monitor. Jun 4, 17:21:37 GMT+0 - Resolved - We have resolved the performance issues on OP Mainnet. The performance issues were a result of transactions with a high I/O cost coinciding with op-geth's automated background compaction. We have implemented multiple mitigations to avoid such scenarios happening in the future. We will also be upgrading the underlying hardware OP Mainnet runs on in order to provide additional buffer.