eReceptionist experienced a critical incident on January 14, 2019 affecting Carrier: US Primary, lasting 3h 39m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 14, 2019, 06:59 PM UTC
Currently investigating
- resolved Jan 14, 2019, 07:00 PM UTC
Resolved. Postmortem to follow.
- postmortem Jan 14, 2019, 07:32 PM UTC
## Postmortem **We’re very sorry that this issue occurred and the difficulties it may have caused our customers!** The underlying cause of this issue was a bad port on one of the SIP routers causing all SIP traffic to be blocked. ## Action Plan 1\. Identify how to arrange the network communications such that a bad port can no longer be a single point of failure and additional routes are available for the traffic. 2\. Make the changes necessary to update the infrastructure to implement this preventative measure. 3\. Test the result to ensure the same type of failure cannot occur again.