ST Math experienced a major incident on September 10, 2021 affecting ST Math Staff Experience and ST Math Learner Experience, lasting 1h 23m. The incident has been resolved; the full update timeline is below.
Affected components
ST Math Staff ExperienceST Math Learner Experience
Update timeline
- investigating Sep 10, 2021, 02:18 PM UTC
Our engineering team is working to identify the root cause and implement a solution.
- monitoring Sep 10, 2021, 02:43 PM UTC
A fix has been implemented and we are monitoring the results.
- monitoring Sep 10, 2021, 02:58 PM UTC
We are continuing to monitor for any further issues.
- identified Sep 10, 2021, 05:35 PM UTC
Potential cause identified, we are working on a solution.
- monitoring Sep 10, 2021, 06:41 PM UTC
A fix has been implemented and we are monitoring the results. (connection limits adjusted on containers and Redis disabled)
- monitoring Sep 10, 2021, 06:57 PM UTC
We are continuing to monitor for any further issues. (Redis re-enabled)
- resolved Sep 10, 2021, 07:57 PM UTC
This incident has been resolved. (90 minutes of no errors and high performance)