LUMASERV incident

Degraded network availability

Major Resolved View vendor source →

LUMASERV experienced a major incident on June 10, 2020 affecting Core Network and Mail Gateway and 1 more component, lasting 7h 20m. The incident has been resolved; the full update timeline is below.

Started
Jun 10, 2020, 11:28 AM UTC
Resolved
Jun 10, 2020, 06:48 PM UTC
Duration
7h 20m
Detected by Pingoru
Jun 10, 2020, 11:28 AM UTC

Affected components

Core NetworkMail GatewayNICAPI - Rest [v1]DDoS ProtectionCEPH-StorageReseller-Interface [reseller.lumaserv.com]Ticket SupportBackupstoragedocs.nicapi.euPhone Support

Update timeline

  1. investigating Jun 10, 2020, 11:28 AM UTC

    Currently we are experiencing packet loss via some routes. We are investigating the problem.

  2. monitoring Jun 10, 2020, 11:37 AM UTC

    For now the network looks stable again. We will keep monitoring and currently checking configuration changes to optimize for future.

  3. monitoring Jun 10, 2020, 11:40 AM UTC

    We are continuing to monitor for any further issues.

  4. monitoring Jun 10, 2020, 11:46 AM UTC

    We are continuing to monitor for any further issues.

  5. investigating Jun 10, 2020, 01:50 PM UTC

    At 15:40 CET for a few seconds we saw again packet loss via some routes. We're doing some optimizations and keep monitoring.

  6. monitoring Jun 10, 2020, 01:51 PM UTC

    A fix has been implemented and we are monitoring the results.

  7. resolved Jun 10, 2020, 06:48 PM UTC

    This incident has been resolved.