Locomote incident

Workflow loading issue

Major Resolved View vendor source →

Locomote experienced a major incident on March 18, 2025 affecting Travel Management Platform, lasting 1h 32m. The incident has been resolved; the full update timeline is below.

Started
Mar 18, 2025, 09:59 PM UTC
Resolved
Mar 18, 2025, 11:31 PM UTC
Duration
1h 32m
Detected by Pingoru
Mar 18, 2025, 09:59 PM UTC

Affected components

Travel Management Platform

Update timeline

  1. identified Mar 18, 2025, 09:59 PM UTC

    The issue has been identified and a fix is being worked on.

  2. identified Mar 18, 2025, 10:14 PM UTC

    Workflow loading issue has been resolved. We're investigating a secondary issue with reporting access for admins.

  3. monitoring Mar 18, 2025, 11:31 PM UTC

    Reporting auth issue is now also resolved, we are monitoring for any further issues.

  4. resolved Mar 19, 2025, 12:02 AM UTC

    Reporting auth issue is now also resolved, we are monitoring for any further issues.

  5. postmortem Mar 20, 2025, 02:01 PM UTC

    We apologise for any disruption this caused by our recent partial outage, which affected workflow and report loading. The root cause of the issue was preparatory work recently put in place for planned future upgrades, which revealed a configuration mismatch between our production and development/test environments that allowed this issue to bypass both manual and automated testing. We’ve since adjusted our test environments to align with the production configuration in question, and confirmed the issue is now correctly caught in automated tests. We are confident this class of problem is now remediated.