TeamDynamix incident

Investigating performance degradation

Minor Resolved View vendor source →

TeamDynamix experienced a minor incident on June 2, 2025 affecting Web Interface, lasting 1d 12h. The incident has been resolved; the full update timeline is below.

Started
Jun 02, 2025, 12:40 PM UTC
Resolved
Jun 04, 2025, 12:44 AM UTC
Duration
1d 12h
Detected by Pingoru
Jun 02, 2025, 12:40 PM UTC

Affected components

Web Interface

Update timeline

  1. investigating Jun 02, 2025, 12:40 PM UTC

    We are actively investigating reports of performance degradation this morning. This seems to mostly affect the Work Management (Users: formerly TDNext) interface at this time.

  2. investigating Jun 02, 2025, 01:40 PM UTC

    TeamDynamix Engineering and Infrastructure teams continue to investigate the cause of Work Management performance degradation today. We thank you for your patience as we work towards a solution to this issue.

  3. investigating Jun 02, 2025, 02:55 PM UTC

    Thank you for your continued patience as investigation continues. We are nearing a fix for the issue that has caused this degradation. TeamDynamix Engineering and Infrastructure teams continue work to develop the fix for this Work Management degradation. We'll provide updates as soon as possible.

  4. investigating Jun 02, 2025, 04:01 PM UTC

    Thank you for your continued patience as investigation continues. TeamDynamix Engineering and Infrastructure teams continue to work to develop the fix for the Work Management degradation. We'll provide updates as soon as possible.

  5. monitoring Jun 02, 2025, 05:12 PM UTC

    TeamDynamix experienced performance issues today following the release of some important new capabilities over the weekend. Due to a technical concern, we have decided to roll back the new version of the service for the US-based customers who received it this weekend. *This rollback only impacts the group of US-based customers that went live on the new UX in this specific wave.* We successfully rolled out the new UX to 30% of customers prior to this weekend, and these performance issues were not previously seen. We apologize for the inconvenience, and we will be in close contact on next steps.

  6. monitoring Jun 02, 2025, 07:14 PM UTC

    The Sandbox environments of the new version has been rolled back. At this point both Production and Sandbox have been rolled back for this group of environments. *This rollback only impacts the group of US-based customers that went live on the new UX last weekend.*

  7. monitoring Jun 02, 2025, 07:15 PM UTC

    Performance has been restored. We are still investigating the root cause and will provide updates as we have them.

  8. resolved Jun 04, 2025, 12:44 AM UTC

    The performance degradation that impacted the TeamDynamix Work Management application on June 2, 2025, has been resolved. Service has been fully restored and is operating normally. As previously communicated, we rolled back the update for a group of US-based customers who had received the new UI over the weekend. This rollback was necessary to stabilize the platform and ensure consistent performance for all users. We recognize the impact this incident had across our customer base and sincerely apologize for the disruption. We are actively completing our root cause analysis and will share more information shortly. This will include a summary of the root cause and contributing factors. Additionally, a revised rollout plan for the customers who still need to receive the new UI will be shared as soon as it is available. Thank you for your patience and partnership as we work to improve your experience.