Cuseum incident

Issue Identified with Blackbaud Altru API for integration

Minor Resolved View vendor source →

Cuseum experienced a minor incident on June 25, 2024 affecting Fetch API, lasting 3d 5h. The incident has been resolved; the full update timeline is below.

Started
Jun 25, 2024, 02:33 PM UTC
Resolved
Jun 28, 2024, 08:22 PM UTC
Duration
3d 5h
Detected by Pingoru
Jun 25, 2024, 02:33 PM UTC

Affected components

Fetch API

Update timeline

  1. identified Jun 25, 2024, 02:33 PM UTC

    We have identified an issue affecting Altru customers. It appears that Blackbaud Altru API is returning an unauthorized or access-denied response on their side. Our team is monitoring Blackbaud's progress in resolving the issue. You can follow the Blackbaud issue here: https://status.blackbaud.com/incidents/c3dthxf0s8qy If you require further information, please don't hesitate to contact our support team.

  2. monitoring Jun 26, 2024, 01:58 AM UTC

    Update from Blackbaud Altru team: Engineers have made a configuration change and are now seeing a lower volume of authorization errors coming from API requests. We will continue to monitor overnight to determine if additional changes are needed. Please continue to reference this page for updates. We expect to have additional updates by 11:00 AM ET. You can follow the progress here: https://status.blackbaud.com/incidents/c3dthxf0s8qy

  3. investigating Jun 26, 2024, 01:40 PM UTC

    Update from Blackbaud Altru®: Following the configuration change, we continue to see intermittent occurrences of these errors in logs and embedded OData connections, and are continuing to investigate. Please continue to reference this page for update. You can follow the progress here: https://status.blackbaud.com/incidents/c3dthxf0s8qy

  4. identified Jun 27, 2024, 03:56 PM UTC

    Update from Blackbaud Altru®: Our efforts to diagnose and resolve this issue were impacted on 6-26 by an Azure outage in the US East Region, which was resolved around 8:30 PM on 6-26. With yesterday's outage resolved, we have been able to identify the root cause of this issue and are working to resolve it as quickly as possible. Please continue to reference this page for updates. ---- You can follow their updates here: https://status.blackbaud.com/incidents/c3dthxf0s8qy

  5. monitoring Jun 28, 2024, 06:23 AM UTC

    Update from Blackbaud Altru®: Engineers have deployed a fix for the API request errors. We are continuing to monitor system performance. We will provide a progress update at 10:30AM ET. Please continue to reference this page for updates. ---- You can follow their updates here: https://status.blackbaud.com/incidents/c3dthxf0s8qy

  6. resolved Jun 28, 2024, 08:22 PM UTC

    We are pleased to report that the issue with Blackbaud Altru® API has been resolved. We have confirmed that all systems are operating as expected. If you have any further questions or concerns, please don't hesitate to contact our support team. ---- Full track about the issue on Blackbaud Altru® API: https://status.blackbaud.com/incidents/c3dthxf0s8qy