TeamDynamix Outage History

TeamDynamix has been made aware of ongoing high-level Azure networking issue that are presently affecting all of our Azure hosting (Work Management and iPaaS) in East US. We will monitor and provide updates until Azure confirms this is resolved.

We are investigating an issue regarding the usage of the Web API to create tickets which results in specified custom attributes not having values set for them.

Investigating client-licensed resource issues regarding access to interact with appropriate areas of Projects via the client portal. Client users are unable to add new issues and update tasks on project plans that they've been assigned to.

We are investigating a delay in webhooks executions that began approximately around 2:14 PM ET. We're taking steps to mitigate the delays as soon as possible.

TeamDynamix is currently investigating reports of latency and increased error rates. We will provide updates as soon as possible, though database reporting metrics appear to have returned to normal as of this time.

We are currently investigating an issue where email monitors are not draining as expected.

We are currently investigating reports of performance degradation around the iPaaS user interface page loads. At this time iPaaS flows are executing at expected levels and remain fully operational.

We are currently investigating reports of unhandled errors when accessing tickets in Work Management.

We have noticed an increased error rate in the loading of charts and are investigating.

We have noticed instances of increased response times and are taking corrective efforts to reduce those to normal levels. We'll provide updates here as they are available.

We are currently investigating and taking steps to address reports of increased response times in WorkManagement, mainly centered around dashboard interaction/load times.

The 12.1 production upgrade is live for the majority of the system. We are still processing a cutover which impacts the following services: Item Alerts, KB Article Review Reminders, Project Health Updates, Report Delivery, RSS Feeds, Source Control Events, Ticket SLAs and Ticket Workflow Web Service Steps. We will continue to provide updates as the cutover progresses.

Beginning at around 11:30AM TeamDynamix began to experience latency with our Support ticket outbound email notifications due to the ongoing Amazon AWS outages. This issue is delaying the delivery of outbound notifications when customers submit support tickets or when TeamDynamix personnel respond to items from within our environment which should relay a notification to any customer via emial. We'll provide an update as soon as the AWS outage has been confirmed as resolved or when we see the message delivery delay resolved.

We are continuing to investigate this issue.

We are currently investigating an iPaaS issue where a limited number of iPaaS flows are failing with the error message: "No Indexer available to resolve Identifier." This issue is impacting only a small subset of flows in isolated cases. Our engineering team is actively working to identify the root cause and will provide updates as more information becomes available.

We are actively investigating an issue around users being unable to either create or edit reports.