Logit.io incident

UK - Opensearch underlying hosts are offline

Major Resolved View vendor source →

Logit.io experienced a major incident on May 10, 2023 affecting Search Hosts, lasting 1h 27m. The incident has been resolved; the full update timeline is below.

Started
May 10, 2023, 06:46 AM UTC
Resolved
May 10, 2023, 08:13 AM UTC
Duration
1h 27m
Detected by Pingoru
May 10, 2023, 06:46 AM UTC

Affected components

Search Hosts

Update timeline

  1. investigating May 10, 2023, 06:46 AM UTC

    We are currently investigating this issue.

  2. identified May 10, 2023, 06:50 AM UTC

    A rack at our data centre is offline effective a number of hosts, we are working with our provider to restore access. Update in 1 hour

  3. identified May 10, 2023, 07:56 AM UTC

    We should have the Rack back in less than 1 hour

  4. monitoring May 10, 2023, 08:00 AM UTC

    Servers are back online, we are just monitoring the recovery

  5. monitoring May 10, 2023, 08:02 AM UTC

    Stacks are now processing queued messages

  6. resolved May 10, 2023, 08:13 AM UTC

    All stacks are operating as we expect and processing messages