Layer Systems incident

Degraded performance on all clusters

Major Resolved View vendor source →

Layer Systems experienced a major incident on October 31, 2022 affecting Layer App and Layer API and 1 more component, lasting 11h 56m. The incident has been resolved; the full update timeline is below.

Started
Oct 31, 2022, 03:45 PM UTC
Resolved
Nov 01, 2022, 03:42 AM UTC
Duration
11h 56m
Detected by Pingoru
Oct 31, 2022, 03:45 PM UTC

Affected components

Layer AppLayer APILayer Exchange & Office 365 ConnectorData Manager

Update timeline

  1. monitoring Oct 31, 2022, 03:45 PM UTC

    Our engineering team is currently investigating an issue causing degraded performance across all instances. We will update this incident with further details every hour until resolution.

  2. monitoring Oct 31, 2022, 06:13 PM UTC

    Engineers are continuing to investigate the root cause of the latency issues. Further updates will be provided shortly.

  3. monitoring Oct 31, 2022, 07:13 PM UTC

    Data engineers are continuing to investigate the issue with an upstream provider. Further updates will be provided shortly.

  4. monitoring Oct 31, 2022, 09:42 PM UTC

    Teams are continuing to work on reducing latency on our production cluster. ETR is approximately 04:30 GMT (1/11)

  5. resolved Nov 01, 2022, 03:42 AM UTC

    A fix has been implemented and engineers will continue to monitor services on Tuesday.