7pace Timetracker incident

Azure DevOps is unstable, extensions could be missing for some customers

Major Resolved View vendor source →

7pace Timetracker experienced a major incident on January 31, 2023 affecting Azure DevOps, lasting 1d 21h. The incident has been resolved; the full update timeline is below.

Started
Jan 31, 2023, 01:49 PM UTC
Resolved
Feb 02, 2023, 10:50 AM UTC
Duration
1d 21h
Detected by Pingoru
Jan 31, 2023, 01:49 PM UTC

Affected components

Azure DevOps

Update timeline

  1. identified Jan 31, 2023, 01:49 PM UTC

    Azure DevOps is unstable, extensions could be missing for some customers (error 404 is shown or extensions are completely missing in Azure DevOps). We've reported this to Azure DevOps team.

  2. identified Jan 31, 2023, 02:13 PM UTC

    We've also found that this issue could appear as an empty Timetracker extension page with the error message "An error occurred when calling the external API. Click 'Refresh' to reload the page."

  3. monitoring Feb 01, 2023, 02:10 PM UTC

    We are monitoring the state of Azure DevOps, and waiting for additional details from them

  4. resolved Feb 02, 2023, 10:50 AM UTC

    The Azure DevOps team confirmed they'd mitigated the issue