Textable incident

Application Outage

Major Resolved View vendor source →

Textable experienced a major incident on November 15, 2023 affecting Application and Application and 1 more component, lasting 12h 1m. The incident has been resolved; the full update timeline is below.

Started
Nov 15, 2023, 09:23 PM UTC
Resolved
Nov 16, 2023, 09:25 AM UTC
Duration
12h 1m
Detected by Pingoru
Nov 15, 2023, 09:23 PM UTC

Affected components

ApplicationApplicationMessaging BackendMessaging BackendAPI

Update timeline

  1. investigating Nov 15, 2023, 09:23 PM UTC

    Some customers are reporting downtime in our web application

  2. investigating Nov 15, 2023, 09:28 PM UTC

    Message delivery seems to be unaffected. The front end application is failing to load and showing an "Application Error" screen. Some mobile apps are working, but some are showing only a black screen.

  3. investigating Nov 15, 2023, 09:47 PM UTC

    We've identified the cause as an issue with one of our upstream service providers. Message delivery should not be affected; however, access to messages remains affected.

  4. investigating Nov 15, 2023, 10:30 PM UTC

    Some customers are reporting a service restoration. Our upstream service provider has published an incident tracking URL: https://status.firebase.google.com/incidents/JH8hiSsfnSZHMdZqFTaC

  5. investigating Nov 16, 2023, 12:36 AM UTC

    Our vendor has attempted initial steps to mitigate the issue, which have not proven to be successful. They are continuing to investigate and will provide an update as needed. Some users continue to report service restoration (possibly depending on regionality / location of end user).

  6. resolved Nov 16, 2023, 09:25 AM UTC

    Our vendor notified us that further mitigation efforts were successful and services were fully restored around 9:45pm EST.