SPARC Media Hub experienced a major incident on September 11, 2023 affecting Texting Services, lasting 4h 7m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 11, 2023, 04:44 PM UTC
Texting engineers are currently investigating increased error rates with message delivery. At this time, messaging may experience issues or delays. Thank you for your patience. We will provide further updates as they become available.
- identified Sep 11, 2023, 04:53 PM UTC
Engineers have identified this issue as being related to a system issue currently being experienced by our primary carrier partner. Relevant carrier engineers are investigating. Impact: Messaging outage (inbound & outbound) on Canada Long Code numbers.
- identified Sep 11, 2023, 05:10 PM UTC
Carrier-side engineers continue to investigate this issue. Thank you for your continued patience. Impact: Messaging outage (inbound & outbound) on Canada Long Code numbers.
- identified Sep 11, 2023, 06:35 PM UTC
Carrier-side engineers continue to investigate this issue. Thank you for your continued patience. Impact: Messaging outage (inbound & outbound) on Canada Long Code numbers.
- identified Sep 11, 2023, 06:41 PM UTC
Carrier-side engineers have identified the root cause of this issue as an issue with their cloud messaging database and have engaged their cloud provider's engineering team to work towards a resolution. This is being treated with the highest priority for all teams involved. Thank you for your continued patience.
- monitoring Sep 11, 2023, 07:44 PM UTC
Carrier-side engineers have fixed the root cause of this issue and we are seeing messages being sent through successfully. We are going to continue to monitor while the carriers queues are being processed. Thank you for your continued patience.
- resolved Sep 11, 2023, 08:51 PM UTC
Texting services have been fully restored. Any issues, please reach out to support.