Datadog Integration incident

Microsoft Teams Connector not delivering notifications to channels

Major Resolved View vendor source →

Datadog Integration experienced a major incident on July 18, 2024 affecting Microsoft 365, lasting 4d 20h. The incident has been resolved; the full update timeline is below.

Started
Jul 18, 2024, 04:45 PM UTC
Resolved
Jul 23, 2024, 01:23 PM UTC
Duration
4d 20h
Detected by Pingoru
Jul 18, 2024, 04:45 PM UTC

Affected components

Microsoft 365

Update timeline

  1. investigating Jul 18, 2024, 04:45 PM UTC

    We are currently investigating reports of the Datadog Connector not delivering notifications to Microsoft Teams. We have informed Microsoft and are working with them to resolve the issue.

  2. investigating Jul 18, 2024, 08:21 PM UTC

    We are continuing to work with Microsoft to resolve the issue. The issue is isolated to Office 365 connectors for Microsoft Teams, and does not affect Datadog’s tenant-based integration. Instructions to migrate can be found here: https://docs.datadoghq.com/integrations/microsoft_teams/#migrate-legacy-connectors-to-tenant-based-integration

  3. investigating Jul 18, 2024, 10:49 PM UTC

    Microsoft has informed us that they are actively working on the issue and will be providing an update on July 19th between 10 AM - 11 AM Eastern Time. The issue is isolated to Office 365 connectors for Microsoft Teams, and does not affect Datadog’s tenant-based integration. Instructions to migrate can be found here: https://docs.datadoghq.com/integrations/microsoft_teams/#migrate-legacy-connectors-to-tenant-based-integration

  4. investigating Jul 19, 2024, 09:30 PM UTC

    Microsoft is currently working on a fix for this issue. Their estimated resolution is early next week. The issue is isolated to Office 365 connectors for Microsoft Teams, and does not affect Datadog’s tenant-based integration. Instructions to migrate can be found here: https://docs.datadoghq.com/integrations/microsoft_teams/#migrate-legacy-connectors-to-tenant-based-integration.

  5. monitoring Jul 22, 2024, 10:03 PM UTC

    We are observing an increase in the number of successful notifications as well as a decrease in failures. We are are continuing to work with Microsoft on a resolution for this issue.

  6. resolved Jul 23, 2024, 01:23 PM UTC

    Connectivity issues with Microsoft have been resolved. Notifications are now being delivered successfully.