Appfire incident

TTS-3337: Continuous spinner on the SLA panel for some instances

Minor Resolved View vendor source →

Appfire experienced a minor incident on July 31, 2024 affecting Time to SLA, lasting 1d 2h. The incident has been resolved; the full update timeline is below.

Started
Jul 31, 2024, 10:05 AM UTC
Resolved
Aug 01, 2024, 12:33 PM UTC
Duration
1d 2h
Detected by Pingoru
Jul 31, 2024, 10:05 AM UTC

Affected components

Time to SLA

Update timeline

  1. investigating Jul 31, 2024, 10:05 AM UTC

    We are currently investigating this issue.

  2. identified Jul 31, 2024, 10:09 AM UTC

    We identified an issue with a high number of messages causing heavy load on our system, affecting the rendering of SLA panels. Current Status: We temporarily disabled certain queues to reduce the load, and panels are now visible again. We are investigating the root cause of the issue.

  3. monitoring Jul 31, 2024, 01:09 PM UTC

    After disabling certain queue, our system caught up with the load. We now enabled the ordinary processing queues and system is fully operational. Our team monitor the status closely.

  4. resolved Aug 01, 2024, 12:33 PM UTC

    Service is restored. No similar issues for the past 12 hours.