Bouncer incident

System and API stability issue

Minor Resolved View vendor source →

Bouncer experienced a minor incident on December 5, 2023 affecting API, lasting 3h 15m. The incident has been resolved; the full update timeline is below.

Started
Dec 05, 2023, 10:55 AM UTC
Resolved
Dec 05, 2023, 02:11 PM UTC
Duration
3h 15m
Detected by Pingoru
Dec 05, 2023, 10:55 AM UTC

Affected components

API

Update timeline

  1. investigating Dec 05, 2023, 10:55 AM UTC

    We are going through temporary problems with API stability, which may result in verification errors. The entire team is working on a solution as soon as possible. We will keep you updated on the progress.

  2. identified Dec 05, 2023, 10:55 AM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Dec 05, 2023, 11:40 AM UTC

    The system and API are stable now. The root cause has been identified. An issue with the DNS resolving library was causing one of the services to crash.

  4. resolved Dec 05, 2023, 02:11 PM UTC

    Issue has been resolved.