CourseArc incident

Slow Load Times

Major Resolved View vendor source →

CourseArc experienced a major incident on January 25, 2021 affecting Application, lasting 2h 46m. The incident has been resolved; the full update timeline is below.

Started
Jan 25, 2021, 03:59 PM UTC
Resolved
Jan 25, 2021, 06:46 PM UTC
Duration
2h 46m
Detected by Pingoru
Jan 25, 2021, 03:59 PM UTC

Affected components

Application

Update timeline

  1. investigating Jan 25, 2021, 03:59 PM UTC

    We are currently experiencing slow load times and 504 Gateway Errors. We are currently investigating and will update shortly.

  2. identified Jan 25, 2021, 04:08 PM UTC

    We have identified a problematic slow database query and we are deploying a fix as quickly as possible.

  3. monitoring Jan 25, 2021, 04:26 PM UTC

    We have deployed a fix and all load time and server metrics are looking much better. We are continuing to monitor. Students and instructors may notice that upon LTI launch, they are being directed to the first page of the module of content, rather than where they last left off. This is a result of the emergency fix that we deployed and we will be addressing this within the next week.

  4. monitoring Jan 25, 2021, 05:04 PM UTC

    We are seeing slow load times again and we are investigating.

  5. identified Jan 25, 2021, 05:33 PM UTC

    We have identified an additional slow query and are working as quickly as possible to deploy a fix.

  6. identified Jan 25, 2021, 06:02 PM UTC

    We have deployed an additional fix and all load time and server metrics are looking much better. We are continuing to monitor.

  7. resolved Jan 25, 2021, 06:46 PM UTC

    This incident has been resolved.