Hedera incident

Hedera Testnet Outage

Critical Resolved View vendor source →

Hedera experienced a critical incident on August 25, 2020 affecting Hedera Testnet (v0.73.0) | Network Uptime, lasting 1d 2h. The incident has been resolved; the full update timeline is below.

Started
Aug 25, 2020, 02:31 PM UTC
Resolved
Aug 26, 2020, 05:29 PM UTC
Duration
1d 2h
Detected by Pingoru
Aug 25, 2020, 02:31 PM UTC

Affected components

Hedera Testnet (v0.73.0) | Network Uptime

Update timeline

  1. investigating Aug 25, 2020, 02:31 PM UTC

    Hedera is observing a network-wide outage on testnet. We are investigating the cause and working to mitigate the impact on applications. The Hedera previewnet is still online.

  2. identified Aug 26, 2020, 12:27 AM UTC

    The issue has been identified. The Hedera team is working on a state restoration and plans to bring services back online by 8/26/2020. In the meantime, the Preview - Testnet is available for usage.

  3. monitoring Aug 26, 2020, 05:27 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Aug 26, 2020, 05:29 PM UTC

    We acknowledge the impact this might have caused. Hedera has resolved the issue, and services have resumed. During the outage, Hedera discovered a race-condition was the cause of the error. A new patch was deployed via a release candidate and has since fixed the error. For further information, please see the release notes. https://github.com/hashgraph/hedera-services/releases/tag/v0.7.0-rc2