Doppler incident

Secrets unable to be read

Critical Resolved View vendor source →

Doppler experienced a critical incident on August 29, 2022 affecting API (api.doppler.com) and Dashboard (dashboard.doppler.com), lasting 59m. The incident has been resolved; the full update timeline is below.

Started
Aug 29, 2022, 12:38 AM UTC
Resolved
Aug 29, 2022, 01:38 AM UTC
Duration
59m
Detected by Pingoru
Aug 29, 2022, 12:38 AM UTC

Affected components

API (api.doppler.com)Dashboard (dashboard.doppler.com)

Update timeline

  1. investigating Aug 29, 2022, 01:01 AM UTC

    We are currently investigating this issue.

  2. monitoring Aug 29, 2022, 01:32 AM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Aug 29, 2022, 01:38 AM UTC

    This issue was caused by a redis server running out of memory. We've increased the amount of memory allotted to this server. We'll also be setting up additional alerting on redis resource usage so that we can catch and prevent these issues in the future.