Tripleseat incident

Email Provider Degradation Causing Deferrals

Minor Resolved

Tripleseat experienced a minor incident on October 25, 2024, lasting 3h 52m. The incident has been resolved; the full update timeline is below.

Started
Oct 25, 2024, 04:03 PM UTC
Resolved
Oct 25, 2024, 07:56 PM UTC
Duration
3h 52m
Detected by Pingoru
Oct 25, 2024, 04:03 PM UTC

Update timeline

  1. resolved Oct 25, 2024, 04:11 PM UTC

    Our teams are aware of an issue impacting email delivery on the Tripleseat and EventUp Planner platforms, caused by a service disruption from our third-party email provider. As a result, some emails may show as "Deferred" or encounter "Internal server error" messages. Our incident response team is actively monitoring the situation and working closely with our provider to resolve this issue as quickly as possible. At this time, we are awaiting further updates from them to fully restore email functionality. We appreciate your patience and will keep you informed as more information becomes available. Please refer to our status page for the latest updates.

  2. resolved Oct 25, 2024, 04:38 PM UTC

    Update: SendGrid engineers are actively investigating the issue. Email sends may experience an increase in email deferrals; however, there is currently no loss of emails being observed. The emails that are deferred are being retried and successfully delivering. We will provide another update in an hour or as soon as more updates become available.

  3. resolved Oct 25, 2024, 05:36 PM UTC

    Update: SendGrid engineers are continuing to investigate the issue. Email sends may experience an increase in email deferrals; however, there is currently no loss of emails being observed. The emails that are deferred are being retried and successfully delivering. We will provide another update in an hour or as soon as more updates become available.

  4. resolved Oct 25, 2024, 06:27 PM UTC

    Update: Identified - Sendgrid's engineers have identified the issue and are working toward a fix for the deferral events. We will provide another update in 1 hour or as soon as more information becomes available.

  5. resolved Oct 25, 2024, 06:38 PM UTC

    Incident status: Monitoring SendGrid's engineers have implemented a fix and are monitoring system performance. We are monitoring deliverability on our end as well to ensure deferred messages are resent. We will provide another update in 1 hour or as soon as more information becomes available.

  6. resolved Oct 25, 2024, 07:55 PM UTC

    Update: Incident resolved We have monitored the fix and confirmed the issue with deferrals occurring with Internal Server Error has been resolved. All services are now operating normally at this time. You should begin to see previously deferred messages sending as expected shortly.