Census incident

Some syncs failing with "Missing corresponding dataset file for prefix: record_deletes.0"

Major Resolved View vendor source →

Census experienced a major incident on February 5, 2025 affecting Sync Engine, lasting 51m. The incident has been resolved; the full update timeline is below.

Started
Feb 05, 2025, 10:38 PM UTC
Resolved
Feb 05, 2025, 11:30 PM UTC
Duration
51m
Detected by Pingoru
Feb 05, 2025, 10:38 PM UTC

Affected components

Sync Engine

Update timeline

  1. identified Feb 05, 2025, 10:38 PM UTC

    A recent code change introduced a bug resulting in some syncs failing with the message "Missing corresponding dataset file for prefix: record_deletes.0". We have identified the problematic change, and a revert is in progress.

  2. monitoring Feb 05, 2025, 10:56 PM UTC

    The revert has deployed. We are monitoring to ensure that the errors subside.

  3. resolved Feb 05, 2025, 11:30 PM UTC

    No errors have been seen for over 30 minutes. We are declaring the incident resolved.