Technical Incident - Mail and Stat Delays, v2/v3 API Calls and Site Down

Update timeline

1. investigating Jul 28, 2020, 04:56 PM UTC

   Our downstream messaging provider (SendGrid) is experiencing an outage. We are seeing mail and stat delays (including Legacy and New Marketing Campaigns). Mail is being accepted but could be stuck in queue. Users may be experiencing a higher volume of v2/v3 API call errors, especially 5xx errors around 9:45 AM MT. Details can be found: https://status.sendgrid.com/incidents/c2k6nqpr9t7p

2. identified Jul 28, 2020, 07:07 PM UTC

   Note from sendgrid: We believe we have identified the source of the issue which has been affecting our services. Our team has tested the remediation steps and are now working toward recovering all remaining impacted services. We will provide another update in 30 minutes or sooner as they become available. We sincerely apologize for the inconvenience this has caused and thank you for your patience. (https://status.sendgrid.com/)

3. monitoring Jul 28, 2020, 07:52 PM UTC

   Sendgrid has implemented a fix and is currently monitoring the situation. All systems seem to be operating.

4. resolved Jul 28, 2020, 09:30 PM UTC

   This incident has been resolved: We have recovered the remaining impacted services and are continuing to monitor system performances. https://status.sendgrid.com/incidents/c2k6nqpr9t7p