Celeste incident

[Network] Basel Network Partial Outage - TA 36415

Major Resolved View vendor source →

Celeste experienced a major incident on May 9, 2025, lasting 6d 19h. The incident has been resolved; the full update timeline is below.

Started
May 09, 2025, 11:11 AM UTC
Resolved
May 16, 2025, 06:43 AM UTC
Duration
6d 19h
Detected by Pingoru
May 09, 2025, 11:11 AM UTC

Update timeline

  1. investigating May 09, 2025, 11:11 AM UTC

    * Information: A switch part of a redundant cluster is down * Problem: The services that are not using the redundancy setup are impacted * Start of the Problem: 2024-05-09 05:55 * Outage Reference: TA 36415 * List of Impacted Services: Mail Platform + Kiosk Selfcare Login ( If using Mail Login Backend ) + Some customer infra

  2. identified May 09, 2025, 11:14 AM UTC

    * Actions 1) The switch has been restarted but is not recovering yet * Status - Our teams are working on the issue

  3. identified May 09, 2025, 11:16 AM UTC

    We are continuing to work on a fix for this issue.

  4. monitoring May 09, 2025, 11:17 AM UTC

    * Status - Network Status : The network part has been fixed at 09:25 * Actions 1) 2nd switch was also restarted once 1st one was back 2) Some Virtual Machines needed to be restarted to have all services recovering

  5. resolved May 16, 2025, 06:43 AM UTC

    * Information The faulty equipment got replaced https://celeste.statuspage.io/incidents/w2s4wj8mpd2x