CommCare HQ incident

Degraded performance affecting conditional alert emails on www.commcarehq.org

Minor Resolved View vendor source →

CommCare HQ experienced a minor incident on October 25, 2023 affecting SMS / Messaging, lasting 5h 12m. The incident has been resolved; the full update timeline is below.

Started
Oct 25, 2023, 02:01 PM UTC
Resolved
Oct 25, 2023, 07:13 PM UTC
Duration
5h 12m
Detected by Pingoru
Oct 25, 2023, 02:01 PM UTC

Affected components

SMS / Messaging

Update timeline

  1. investigating Oct 25, 2023, 02:01 PM UTC

    Dear Users, At 12:44 PM UTC, we observed an issue on www.commcarehq.org where conditional alert email messages set up by users were not going through and instead show a status of “In Progress”. Our developers are currently investigating this issue with high priority. Should you have any concerns or queries related to it, please contact us at [email protected]. We apologize for any inconvenience that this is causing and will update you regularly on the status page.

  2. identified Oct 25, 2023, 02:33 PM UTC

    Our developers have identified the cause of the issue and are in the process of implementing a fix. We expect a full resolution of this issue within the hour. We will continue to update the status of this issue should there be any changes.

  3. identified Oct 25, 2023, 03:02 PM UTC

    Our developers are still in the process of implementing the fix for this issue. We will continue to update the status of this issue to provide the most up to date information.

  4. identified Oct 25, 2023, 04:09 PM UTC

    Our developers have confirmed and are in the process of implementing the fix for this issue. We expect the resolution of this issue within the next hour. We will continue to update the status of this issue to provide the most up to date information.

  5. identified Oct 25, 2023, 05:08 PM UTC

    We are continuing to work on the fix for this issue. We will continue to update the status of this issue to provide the most up to date information.

  6. identified Oct 25, 2023, 06:10 PM UTC

    We are continuing to work on the fix for this issue. We will continue to update the status of this issue to provide the most up to date information.

  7. monitoring Oct 25, 2023, 07:02 PM UTC

    The fix for this issue has been deployed, and we're monitoring the platform to ensure that the issue has been fully resolved. We apologize for any inconvenience that this has caused and will continue to update you regularly on the status page.

  8. resolved Oct 25, 2023, 07:13 PM UTC

    We have confirmed that the issue is resolved and there are no more occurrences of the problem. Should you have any further concerns or queries related to this issue, please contact us at [email protected]. We sincerely apologize for any inconvenience that this has caused.