Lakeside Software incident

NLQ Agent Queries Issue

Minor Resolved View vendor source →

Lakeside Software experienced a minor incident on October 29, 2025 affecting SysTrack AI and SysTrack AI and 1 more component, lasting 8h 27m. The incident has been resolved; the full update timeline is below.

Started
Oct 29, 2025, 04:00 PM UTC
Resolved
Oct 30, 2025, 12:28 AM UTC
Duration
8h 27m
Detected by Pingoru
Oct 29, 2025, 04:00 PM UTC

Affected components

SysTrack AISysTrack AISysTrack AISysTrack AISysTrack AI

Update timeline

  1. identified Oct 29, 2025, 06:56 PM UTC

    Only NLQ Agent queries are not processing data from the end points due to the ongoing Microsoft Azure Outage (YKYN-BWZ).

  2. identified Oct 29, 2025, 08:18 PM UTC

    We are monitoring the on going Azure outage for recovery.

  3. monitoring Oct 29, 2025, 11:02 PM UTC

    We are continuing to monitor the Azure recovery efforts.

  4. resolved Oct 30, 2025, 12:28 AM UTC

    We have mitigated the issue and are working with our cloud provider to identify the root cause. If you are experiences any problems, please contact support.

  5. postmortem Nov 07, 2025, 05:02 PM UTC

    # What was the issue? NLQ Agent queries responses could not be guaranteed to be processed. # What was the root cause? See Microsoft public RCA located here: [https://azure.status.microsoft/en-us/status/history/](https://azure.status.microsoft/en-us/status/history/) under “Preliminary Post Incident Review \(PIR\) - Azure Front Door - Connectivity issues across multiple regions” # What is the Prevention Strategy? Design a failover back system if Azure Front Door is not available.