Keeper experienced a major incident on December 13, 2023 affecting Keeper Web Vault (US) and Keeper Browser Extensions, lasting 49m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 13, 2023, 05:29 PM UTC
We are investigating intermittent Duo Push issues in the US region. Hard refreshing the browser window appears to mitigate the issue.
- resolved Dec 13, 2023, 06:19 PM UTC
Duo Push issues in the US region have been resolved. It may be necessary to reload the web vault page or restart the web browser.
- postmortem Dec 15, 2023, 06:45 AM UTC
The Keeper engineering team has been researching the cause for recent Duo Push issues. Our investigation has resulted in the identification of a couple issues. The description is below: 1. The Duo Push services also have a direct dependency on the Keeper Push services which utilize websocket communication from the Keeper backend to the client device. 2. We determined that scaling additional instances of our push services was necessary to meet the growing usage of Duo and general push features across the Keeper end-user client apps 3. Scaling the backend instances immediately resolved the latency and the intermittent issues encountered by users. 4. In addition, we met with the Duo team, revisited our Duo integration code and we decided to rewrite some portions of the integration to reduce the number of dependencies and asynchronous processes. This is planned for release by December 20, 2023.