Ooma incident

Phone applications slow to respond

Minor Resolved View vendor source →

Ooma experienced a minor incident on December 1, 2018 affecting Provisioner, lasting 3d 18h. The incident has been resolved; the full update timeline is below.

Started
Dec 01, 2018, 12:18 AM UTC
Resolved
Dec 04, 2018, 07:12 PM UTC
Duration
3d 18h
Detected by Pingoru
Dec 01, 2018, 12:18 AM UTC

Affected components

Provisioner

Update timeline

  1. investigating Dec 01, 2018, 12:18 AM UTC

    We are investigating an issue with our provisioning server. Some requests on our databases are taking longer to complete than normal due to a higher than expected load. On phone applications will be impacted as well as log in/log out functions.

  2. identified Dec 01, 2018, 12:22 AM UTC

    We have identified the cause of the slow responses. Our engineers are currently repairing the database server with the load issues.

  3. monitoring Dec 01, 2018, 12:26 AM UTC

    Timeouts have been removed from the system. All functions have returned to normal. We will continue to monitor for any impact.

  4. monitoring Dec 01, 2018, 12:47 AM UTC

    We have seen some timeouts return to the affect database. We are implementing an additional fix.

  5. monitoring Dec 01, 2018, 12:54 AM UTC

    We have resolved the timeout issues in the cluster impacting Phone applications. We will continue to monitor for further issues.

  6. resolved Dec 04, 2018, 07:12 PM UTC

    This incident has been resolved.