Lakeside Software incident

SysTrack Cloud – Availability Issues

Critical Resolved View vendor source →

Lakeside Software experienced a critical incident on February 29, 2024, lasting 7h 10m. The incident has been resolved; the full update timeline is below.

Started
Feb 29, 2024, 11:48 AM UTC
Resolved
Feb 29, 2024, 06:59 PM UTC
Duration
7h 10m
Detected by Pingoru
Feb 29, 2024, 11:48 AM UTC

Update timeline

  1. investigating Feb 29, 2024, 11:48 AM UTC

    We are currently investigating reported issues with SysTrack Cloud availability in the below regions. Some users may not be able to use the SysTrack cloud UI, make API calls, or use third-party integrations that utilize the API. We're actively working on identifying the root cause. We apologize for any inconvenience and will provide an update once more details become available.

  2. identified Feb 29, 2024, 01:13 PM UTC

    The issue has been identified and a fix is being implemented.

  3. identified Feb 29, 2024, 02:23 PM UTC

    We are continuing to work on a fix for this issue.

  4. monitoring Feb 29, 2024, 02:57 PM UTC

    A fix has been implemented and we are going to be actively monitoring the system.

  5. resolved Feb 29, 2024, 06:59 PM UTC

    This incident has been resolved.

  6. postmortem Mar 07, 2024, 08:14 PM UTC

    # What was the issue? All customers in the impacted region experience problems loading the webpage. # What was the root cause? Our load balancer, Microsoft Application Gateway, stopped accepting traffic inbound. # What is the Prevention Strategy? We are still working with our cloud provider \(Azure\) to get a full RCA before we prepare an identification and prevention strategy.