Helium incident

Incomplete Closure of Epoch 19,674

Notice Resolved View vendor source →

Helium experienced a notice incident on November 14, 2023, lasting —. The incident has been resolved; the full update timeline is below.

Started
Nov 14, 2023, 03:50 PM UTC
Resolved
Nov 14, 2023, 03:50 PM UTC
Duration
Detected by Pingoru
Nov 14, 2023, 03:50 PM UTC

Update timeline

  1. resolved Nov 14, 2023, 03:50 PM UTC

    The automated job that was supposed to end the November 13th epoch (19,674) at UTC midnight stalled due to a dropped transaction. The job continued to wait for confirmation on a transaction that was never picked up by Solana. The epoch was manually ended by Core Developers at 15:30 UTC. No further action is needed. The team will be improving alerting to ensure we are notified earlier when epochs fail to close. Additionally, they will be repairing the automated job to include a timeout on transaction confirmations.