LearnUpon incident

Elevated Error Rates

Minor Resolved View vendor source →

LearnUpon experienced a minor incident on August 5, 2021 affecting LearnUpon Application - EU Region and LearnUpon API, lasting 20h 51m. The incident has been resolved; the full update timeline is below.

Started
Aug 05, 2021, 06:35 PM UTC
Resolved
Aug 06, 2021, 03:26 PM UTC
Duration
20h 51m
Detected by Pingoru
Aug 05, 2021, 06:35 PM UTC

Affected components

LearnUpon Application - EU RegionLearnUpon API

Update timeline

  1. investigating Aug 06, 2021, 12:04 AM UTC

    We've identified a sporadic increase in the rate of errors and are investigating the issue, currently. This is affecting a minority of requests to most portals. We'll update within 30 minutes or sooner as have more details to share.

  2. identified Aug 06, 2021, 12:05 AM UTC

    We are continuing to investigate possible mitigation for the increased level of errors (minority of requests, but affecting most portals)

  3. identified Aug 06, 2021, 12:05 AM UTC

    We have identified the issue as a failed networking component and are working on mitigation in the next few minutes.

  4. monitoring Aug 06, 2021, 12:06 AM UTC

    We have mitigated fully and the error rates are back to normal. We're continuing to monitor and will provide a confirmation update once a permanent fix has been introduced in the morning (UTC). The extent of impact was most portals being affected, but only a minority of requests (at worst) affected, and only for brief spurts of a few seconds over the period. For now, we consider the issue resolved and have not seen errors since.

  5. resolved Aug 06, 2021, 03:26 PM UTC

    The incident in relation to elevated error rates has been resolved fully as of this morning (UTC/GMT). Apologies for the inconvenience this will have caused.