Spiceworks incident

Email Delivery Issue

Minor Resolved View vendor source →

Spiceworks experienced a minor incident on February 6, 2023 affecting Cloud Help Desk, lasting 20h 21m. The incident has been resolved; the full update timeline is below.

Started
Feb 06, 2023, 08:59 PM UTC
Resolved
Feb 07, 2023, 05:20 PM UTC
Duration
20h 21m
Detected by Pingoru
Feb 06, 2023, 08:59 PM UTC

Affected components

Cloud Help Desk

Update timeline

  1. investigating Feb 06, 2023, 08:59 PM UTC

    We are currently investigating an issue that's causing notifications not to be sent out for ticket creation, comments, etc... We're looking into this as a high priority and will update here when more is known.

  2. investigating Feb 07, 2023, 12:05 AM UTC

    We are working with our email service provider (ESP) to resolve the email delivery issue. Email flow outbound from Cloud Help Desk is sending to the ESP successfully, but is being enqueued/held for an unknown reason. The ESP indicated any enqueued messages will deliver once this is resolved.

  3. monitoring Feb 07, 2023, 05:20 AM UTC

    Our email service provider (ESP) has released the outbound email hold and emails are now delivering. Messages queued during this outage should all be delivered, and new messages should see no delay. If you notice any issues please email [email protected] to let us know. We will continue monitoring through Feb. 7. We will also be working with our ESP to prevent such email delivery holds in the future.

  4. resolved Feb 07, 2023, 05:20 PM UTC

    Email delivery has been normal since the last update. We will be working on postmortem/prevention to avoid this type of outage in the future. We know that timely email delivery is key to providing you with a reliable help desk experience. We are taking this one very seriously!