Pulsant incident

Intermittent Connections - LD5 Slough

Notice Resolved View vendor source →

Pulsant experienced a notice incident on December 4, 2024, lasting 1d 9h. The incident has been resolved; the full update timeline is below.

Started
Dec 04, 2024, 04:24 AM UTC
Resolved
Dec 05, 2024, 01:39 PM UTC
Duration
1d 9h
Detected by Pingoru
Dec 04, 2024, 04:24 AM UTC

Update timeline

  1. investigating Dec 04, 2024, 04:24 AM UTC

    Pulsant are aware of ongoing intermittent connection issues to some services connected to a Pulsant core device in LD5. Troubleshooting is ongoing to stabilise services as quickly as possible.

  2. investigating Dec 04, 2024, 05:22 AM UTC

    Engineers are currently working to isolate the fault the by shutting down LINX and a transit provider to try stablise the connection. Please be aware this means a current loss of resilience for the service during this time, whilst engineers continue to apply a fix.

  3. identified Dec 04, 2024, 05:57 AM UTC

    Pulsant are confident the flapping connection has stabilise with isolating some routes. Close monitoring will continue until full resiliency is restored.

  4. monitoring Dec 04, 2024, 08:55 AM UTC

    A workaround has been implemented and Pulsant continue to monitor closely until fix can be applied

  5. resolved Dec 05, 2024, 01:39 PM UTC

    Full resiliency has been restored as of 1600hrs on December 4th, 2024. Pulsant engineers shut down a LINX connection and reviewed/modified BGP configuration.