21st Century Mobile incident
Messaging platform (myMSP) delivery delays
21st Century Mobile experienced a major incident on July 3, 2020 affecting Message delivery queue, lasting 7h 1m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 03, 2020, 02:31 PM UTC
Our Messaging platform (myMSP) has been experiencing delivery issues since 2020-07-03 16:20. The API is accessible but messages are not being sent or delivered. Our team is working to resolve this issue. We will notify you as soon as more information is available. Status: Issue ongoing. Cause: Issue at hosting partner's data center is causing outbound message queue to be inoperable. Impact: Delivery of messages delayed until issue is resolved.
- monitoring Jul 03, 2020, 07:34 PM UTC
Our hosting partner reports that they are still working to fix the issue. We have re-routed our traffic through another channel so message are getting through again. We will monitor the situation and report when everything is back to normal. Status: Temporary work around implemented. Cause: Issue at hosting partner's data center is causing outbound message queue to be inoperable. Impact: Delivery of messages delayed for up to five hours. No messages where lost.
- resolved Jul 03, 2020, 09:32 PM UTC
The issue has been resolved. All queued messages have been sent and delivered. Issue start: 2020-07-03 16:20 Issue resolved: 2020-07-03 22:40 Cause: Issue at hosting partner's data center caused outbound message queue to be inoperable. Impact: Delivery of messages delayed. No messages where lost.