Eleos Technologies incident

Elevated Error Rates

Major Resolved View vendor source →

Eleos Technologies experienced a major incident on December 15, 2023 affecting API and App Manager and 1 more component, lasting 11m. The incident has been resolved; the full update timeline is below.

Started
Dec 15, 2023, 11:07 AM UTC
Resolved
Dec 15, 2023, 11:19 AM UTC
Duration
11m
Detected by Pingoru
Dec 15, 2023, 11:07 AM UTC

Affected components

APIApp ManagerMobile Apps

Update timeline

  1. investigating Dec 15, 2023, 10:24 AM UTC

    As of 10:06 UTC the Eleos Platform started experiencing elevated error rates. This effects the platform APIs, and the mobile apps may fall back into offline mode until the issue is resolved.

  2. investigating Dec 15, 2023, 10:30 AM UTC

    As of 10:29 UTC we have temporary disabled new service errors going to the Error Console or the Error Console API.

  3. monitoring Dec 15, 2023, 11:07 AM UTC

    As of 10:31 UTC error rates on the Eleos Platform have stabilized with mitigations in place, and as of 11:04 UTC we have turned on writing errors to the Error Console and the Error Console API as of 11:04 UTC. We are continuing to monitor the system. Mobile apps should begin to send messages that were capture during the incident, and the platform should be fully operational at this time.

  4. resolved Dec 15, 2023, 11:19 AM UTC

    The Eleos Platform has returned to it's normal operating status. Error rates and overall system performance is have returned to normal. The elevated rates within the Eleos Platform began at 10:07 UTC and back to normal rates at 10:31 UTC where they have remained. API service errors were not captured between 10:29 UTC and 11:04 UTC.