GumGum incident

Increased classification latency in page, text, and video endpoints

Minor Resolved View vendor source →

GumGum experienced a minor incident on November 6, 2024 affecting Verity Api, lasting 3h 14m. The incident has been resolved; the full update timeline is below.

Started
Nov 06, 2024, 07:43 PM UTC
Resolved
Nov 06, 2024, 10:58 PM UTC
Duration
3h 14m
Detected by Pingoru
Nov 06, 2024, 07:43 PM UTC

Affected components

Verity Api

Update timeline

  1. identified Nov 06, 2024, 07:43 PM UTC

    The issue has been identified and a fix is implemented.

  2. monitoring Nov 06, 2024, 08:26 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. monitoring Nov 06, 2024, 09:35 PM UTC

    We have identified that one of our backend services is now currently experiencing delays in processing our backlog of messages. This is translating to high latency across Verity services, specifically for pages, text and video. We are increasing support to our affected system to help it recover and catch-up to our backlog.

  4. resolved Nov 06, 2024, 10:58 PM UTC

    New page, text, and video requests will be processed as usual. However, the backlog of messages accumulated during the outage will be handled at a slower rate, causing additional delays for messages received between 18:38 (UTC) and 22:09 (UTC).