Ooma experienced a major incident on November 20, 2018 affecting Vancouver POP and San Jose POP and 1 more component, lasting 2h 44m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 20, 2018, 07:41 AM UTC
We are currently investigating an issue with a Core Router in our VAN POP. Customers with Voxter Dedicated Voice circuits will not have connectivity via that circuit. Customers with backup connections will failover to our backup POPs. We will post here as we learn more.
- investigating Nov 20, 2018, 07:42 AM UTC
We are continuing to investigate this issue.
- investigating Nov 20, 2018, 07:49 AM UTC
We have technicians onsite in our VAN datat centre facility investigating the issue with one of our core routers and the fibre connectivity into our POP. We will update this page as we know more.
- investigating Nov 20, 2018, 08:05 AM UTC
We are currently performing repairs on the affected equipment. We will update this page again shortly.
- identified Nov 20, 2018, 08:22 AM UTC
We are restoring connectivity to the VAN POP and affected equipment is being brought back online.
- identified Nov 20, 2018, 08:33 AM UTC
We are restoring services in VAN. Preliminary tests and health checks are passing but we expect some continue instability as we resolve the issue.
- identified Nov 20, 2018, 08:46 AM UTC
We are continuing to restore services in VAN POP and will post more updates to this page as we have them.
- identified Nov 20, 2018, 09:01 AM UTC
We are continuing to restore services in VAN POP and will post more updates to this page as we have them.
- identified Nov 20, 2018, 09:27 AM UTC
We have been able to restore the affected router. We are working on bringing stability back to the VAN POP. Dedicated Voice Circuit customers should see connectivity being restored.
- identified Nov 20, 2018, 09:44 AM UTC
We are restoring services in VAN, and have had reports of delayed calls in our SJC POP. We are working on restoring services in both POPs as quickly as possible.
- monitoring Nov 20, 2018, 09:56 AM UTC
Services have been restored for SJC. We are completing so additional restarts of VAN core routers as part of completing repairs.
- monitoring Nov 20, 2018, 10:02 AM UTC
Services have been restored. We are monitoring stability within our network.
- resolved Nov 20, 2018, 10:26 AM UTC
All sites are operational. The Core Router in VAN has been repaired and connectivity issues for SJC and VAN have been resolved. Dedicated Voice Circuit connectivity has been restored. We will provide a post mortem via this page within 24hrs.