Posh AI incident
Voice Bot Voice Input Recognition & Glia Digital Bot Issue
Posh AI experienced a critical incident on October 2, 2023 affecting Voice Assistants and Digital Assistants, lasting 1h 49m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 02, 2023, 07:58 PM UTC
We are currently investigating an issue with voice bots recognizing voice input.
- investigating Oct 02, 2023, 08:19 PM UTC
Some digital bots are also impacted by this outage. We are continuing to investigate.
- investigating Oct 02, 2023, 08:29 PM UTC
We are continuing to investigate this issue.
- investigating Oct 02, 2023, 08:40 PM UTC
The only digital bots impacted by this issue are Glia-integrated bots. We are continuing to investigate this issue. Twilio has updated their status page that they are having issues that are impacting Posh. We are continuing to monitor Twilio's status.
- monitoring Oct 02, 2023, 09:00 PM UTC
Glia-integrated digital bots seem to be working again now. Glia has updated their status page that they are investigating an issue on their end: https://status.glia.com/ We will be continuing to monitor. Voice is still being monitored and is intermittent - Twilio's status page hasn't yet been updated, but we are seeing fewer errors across bots. We are continuing to monitor.
- monitoring Oct 02, 2023, 09:33 PM UTC
We have seen stable voice bot performance for the last 10 minutes. We are continuing to monitor.
- monitoring Oct 02, 2023, 09:45 PM UTC
This issue with voice bots resulted from a Google Speech to Text outage that Twilio (Posh's telephony provider) and Posh relies on. Google has shared that they expect this service to be fully restored by 6:10pm ET. We have been monitoring and haven't seen any issues in the last 30 minutes. We will be monitoring this incident until Google announces full service restoration.
- resolved Oct 02, 2023, 09:48 PM UTC
Google just updated their status to reflect that this issue has been resolved on their end with Speech to Text. So Posh bots should not experience any further issues.