Losant incident

Partial outage of API / databases

Major Resolved View vendor source →

Losant experienced a major incident on October 28, 2021 affecting API, lasting 9h 5m. The incident has been resolved; the full update timeline is below.

Started
Oct 28, 2021, 04:29 PM UTC
Resolved
Oct 29, 2021, 01:35 AM UTC
Duration
9h 5m
Detected by Pingoru
Oct 28, 2021, 04:29 PM UTC

Affected components

API

Update timeline

  1. investigating Oct 28, 2021, 04:29 PM UTC

    We are experiencing issues with our primary configuration storage database. Reading and writing device and workflow configuration is affected. We will provide an update shortly.

  2. identified Oct 28, 2021, 05:00 PM UTC

    The issue has been identified and we are currently working on a fix. We expect to have the issue resolved shortly. We will continue to update this page with more information.

  3. monitoring Oct 28, 2021, 05:12 PM UTC

    We have implemented a fix for the platform outage and the issue has been mitigated. We are continuing to monitor the situation as we put a longer-term resolution in place.

  4. investigating Oct 28, 2021, 07:52 PM UTC

    We are seeing a recurrence of issues, where some users are experience slow read/write performance of application resources.

  5. monitoring Oct 28, 2021, 08:12 PM UTC

    A fix has been implemented for the outage and the issue has been mitigated. We will continue to monitor the situation as we put a longer-term resolution in place.

  6. resolved Oct 29, 2021, 01:35 AM UTC

    A longer term mitigation is now in place, and the system has been operating normally.