Stellar incident

Latency issues in horizon.stellar.org cluster

Minor Resolved View vendor source →

Stellar experienced a minor incident on July 8, 2020 affecting SDF Public Network Horizon, lasting 4h. The incident has been resolved; the full update timeline is below.

Started
Jul 08, 2020, 01:03 PM UTC
Resolved
Jul 08, 2020, 05:04 PM UTC
Duration
4h
Detected by Pingoru
Jul 08, 2020, 01:03 PM UTC

Affected components

SDF Public Network Horizon

Update timeline

  1. investigating Jul 08, 2020, 01:55 PM UTC

    We are seeing slow times on horizon.stellar.org - causing Service Unavailable responses on requests.

  2. investigating Jul 08, 2020, 03:25 PM UTC

    We switched Horizon to a fall back cluster which resolved the issue. We are still investigating the cause.

  3. resolved Jul 08, 2020, 05:04 PM UTC

    The cause was traced to a DB issue. This incident has been resolved and additional mitigations will be applied later today.