CamDiab incident

Delayed and incomplete Companion data delivery

Major Resolved View vendor source →

CamDiab experienced a major incident on October 29, 2023 affecting Companion, lasting 1h. The incident has been resolved; the full update timeline is below.

Started
Oct 29, 2023, 09:30 PM UTC
Resolved
Oct 29, 2023, 10:30 PM UTC
Duration
1h
Detected by Pingoru
Oct 29, 2023, 09:30 PM UTC

Affected components

Companion

Update timeline

  1. investigating Oct 29, 2023, 10:01 PM UTC

    We are currently investigating this issue.

  2. identified Oct 29, 2023, 10:21 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Oct 29, 2023, 10:22 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Oct 29, 2023, 10:30 PM UTC

    This incident has been resolved.

  5. postmortem Oct 29, 2023, 10:34 PM UTC

    **Summary:** We deeply regret the recent disruption to our service, resulting in incomplete data and data delivery delays on Companion. Here is a brief post-mortem analysis of the incident and our sincere apology. **Incident Overview:** On 29 October 2023 at arund 6pm GMT, Companion experienced an unexpected technical issue that led to incomplete data and delayed data delivery for some of our users. **Root Cause:** The incident was caused by mis-configuration during system update. **Mitigation Steps:** Our engineering team quickly identified and resolved the issue by reverting to the original configuration. **Preventive Measures:** To prevent a recurrence of this issue, we are implementing additional monitoring and testing procedures and are actively working on improvements. **Apology:** We understand the frustration and inconvenience this incident may have caused you. We sincerely apologize for the disruption and any inconvenience it may have caused.