GraphCDN incident

Metrics System

Major Resolved View vendor source →

GraphCDN experienced a major incident on July 21, 2023 affecting GraphQL Metrics, lasting 49m. The incident has been resolved; the full update timeline is below.

Started
Jul 21, 2023, 06:53 PM UTC
Resolved
Jul 21, 2023, 07:43 PM UTC
Duration
49m
Detected by Pingoru
Jul 21, 2023, 06:53 PM UTC

Affected components

GraphQL Metrics

Update timeline

  1. investigating Jul 21, 2023, 06:53 PM UTC

    We are currently looking into an issue with our metrics system. Edge Caching and other service are unaffected and operate as expected.

  2. identified Jul 21, 2023, 07:08 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Jul 21, 2023, 07:20 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Jul 21, 2023, 07:43 PM UTC

    The issue has been resolved and the metrics systems are worked as expected again. Some metrics data wasn't properly ingested and is currently saved in a backup system. We will ingest this data into our production systems after additional checks have been run.