BigLeaf incident

Reachability problems for certain domains such as ADP and advisorcompass.

Minor Resolved View vendor source →

BigLeaf experienced a minor incident on June 18, 2024 affecting Gateway Cluster: Dallas, TX and Gateway Cluster: Denver, CO and 1 more component, lasting 1h 11m. The incident has been resolved; the full update timeline is below.

Started
Jun 18, 2024, 04:20 PM UTC
Resolved
Jun 18, 2024, 05:31 PM UTC
Duration
1h 11m
Detected by Pingoru
Jun 18, 2024, 04:20 PM UTC

Affected components

Gateway Cluster: Dallas, TXGateway Cluster: Denver, COGateway Cluster: New York, NY

Update timeline

  1. investigating Jun 18, 2024, 04:20 PM UTC

    We are currently investigating reachability problems to certain websites such as ADP and advisorcompass.

  2. investigating Jun 18, 2024, 04:50 PM UTC

    We've implemented a workaround and are evaluating the results of it.

  3. resolved Jun 18, 2024, 05:31 PM UTC

    We've resolved the reachability problems. From 9am to 12pm Central time, a few websites reachable through a direct peering route were being blackholed inadvertently. Avoiding that peering route resolved the issue. We'll follow up to ensure permanent resolution.