Learnosity incident

Possible issue affecting small number of adaptive sessions not triggering Firehose updates in US-East-1

Notice Resolved View vendor source →

Learnosity experienced a notice incident on May 22, 2024 affecting Adaptive session information, lasting 1h 14m. The incident has been resolved; the full update timeline is below.

Started
May 22, 2024, 06:27 PM UTC
Resolved
May 22, 2024, 07:42 PM UTC
Duration
1h 14m
Detected by Pingoru
May 22, 2024, 06:27 PM UTC

Affected components

Adaptive session information

Update timeline

  1. investigating May 22, 2024, 06:27 PM UTC

    As of 18:10 UTC, we are trying to determine if an issue exists causing a very small number of adaptive sessions to not trigger a Firehose event after scoring in US-East-1. This is just an internal investigation at present, without confirmation, and we have no evidence that any impact outside the described implementation is affected. Learnosity Support and Systems Engineering teams are actively investigating the issue, and will follow on with an update and resolution as soon as possible.

  2. investigating May 22, 2024, 06:33 PM UTC

    As of 18:30 UTC, Learnosity Support and Systems Engineering teams are continuing to investigate this unconfirmed issue and will follow on with an update as soon as possible.

  3. investigating May 22, 2024, 06:47 PM UTC

    As of 18:45 UTC, Learnosity Support and Systems Engineering teams are continuing to investigate an unconfirmed issue, examining less than 500 potentially affected sessions out of 4.93 million submitted over the same period. We will follow on with an update as soon as possible.

  4. monitoring May 22, 2024, 07:01 PM UTC

    As of 19:00 UTC, we have been unable to find any systemic problems, while the number of potentially impacted sessions remains at one hundredth of one percent ( 0.01%) of total submissions over the period investigated, likely due to a content issue. Learnosity Support and Systems Engineering teams will continue to monitor for 30 minutes and expect to close this investigation at that time.

  5. resolved May 22, 2024, 07:42 PM UTC

    As of 19:40 UTC, we believe we've identified content to be the root cause of this tiny number of sessions not passing through scoring and triggering a Firehose event. We've reached out to customer proactively and will help address this issue directly. We are now calling this issue resolved and apologize for any distractions. Please reach out if you have any questions or concerns.