Stellar incident

Testnet ingestion error

Minor Resolved View vendor source →

Stellar experienced a minor incident on October 31, 2020 affecting Stellar Test Network and SDF Test Network Horizon, lasting —. The incident has been resolved; the full update timeline is below.

Started
Oct 31, 2020, 03:13 PM UTC
Resolved
Oct 31, 2020, 03:13 PM UTC
Duration
Detected by Pingoru
Oct 31, 2020, 03:13 PM UTC

Affected components

Stellar Test NetworkSDF Test Network Horizon

Update timeline

  1. investigating Oct 31, 2020, 01:31 PM UTC

    We are experiencing ledger errors on the Stellar testnet. We are currently investigating the incident.

  2. investigating Oct 31, 2020, 02:00 PM UTC

    We are continuing to investigate this issue.

  3. identified Oct 31, 2020, 02:23 PM UTC

    We have identified the issue as a bug in Horizon ingestion related to the protocol 15 changes. Our Horizon team is investigating and we will be following up with a hotfix. No ETR at this time.

  4. resolved Oct 31, 2020, 03:13 PM UTC

    We have deployed a hotfix to our horizon cluster and the horizon cluster is operating as expected. We are going to include the fix in Horizon 1.11.0 release on Nov, 2nd. Please use horizon-testnet.stellar.org before then. We are sorry for inconvenience.