TechnologyOne incident

Unable to access Ci for a subset of Timetabling & Scheduling Users

Major Resolved View vendor source →

TechnologyOne experienced a major incident on September 30, 2024, lasting 1h 41m. The incident has been resolved; the full update timeline is below.

Started
Sep 30, 2024, 07:39 AM UTC
Resolved
Sep 30, 2024, 09:21 AM UTC
Duration
1h 41m
Detected by Pingoru
Sep 30, 2024, 07:39 AM UTC

Update timeline

  1. investigating Sep 30, 2024, 07:39 AM UTC

    Our team are currently investigating problems with launching SDB's and ESDB's in the UK region. Further updates will be provided as more detail becomes available

  2. investigating Sep 30, 2024, 08:07 AM UTC

    Our team are continuing to investigate the root cause of the issue. Further updates will be posted as soon as new information becomes available.

  3. identified Sep 30, 2024, 08:24 AM UTC

    The root cause of the problem has been identified and we are working towards a resolution.

  4. identified Sep 30, 2024, 08:40 AM UTC

    A fix is being deployed incrementally, services should return to normal in the next 10-15 minutes for affected environments.

  5. resolved Sep 30, 2024, 09:21 AM UTC

    This incident has been resolved.

  6. postmortem Oct 14, 2024, 10:13 PM UTC

    **Issue Summary** On 30/09/2024, a subset of users experienced errors when attempting to access Timetabling and Scheduling. This typically manifested a browser specific error message. **Root Cause Analysis** The incident was triggered by a change to the network access control list as part of a planned and pre-tested change. **Corrective Actions** Reverted to the prior configuration. **Preventive Measures** Built a programmatic check for configuration update to templates which will be run on any future updates.