Rudderstack incident

Data loss of small percentage of warehouse events on free tier

Major Resolved View vendor source →

Rudderstack experienced a major incident on March 3, 2025 affecting Warehouses, lasting 1h. The incident has been resolved; the full update timeline is below.

Started
Mar 03, 2025, 09:00 AM UTC
Resolved
Mar 03, 2025, 10:00 AM UTC
Duration
1h
Detected by Pingoru
Mar 03, 2025, 09:00 AM UTC

Affected components

Warehouses

Update timeline

  1. investigating Mar 06, 2025, 09:48 PM UTC

    We are currently investigating this issue.

  2. identified Mar 06, 2025, 09:48 PM UTC

    The issue has been identified and a fix is being implemented.

  3. resolved Mar 06, 2025, 09:48 PM UTC

    This incident has been resolved. During the migration of our internal database, certain custom configurations from the previous version were not restored in the new setup. This led to degraded service performance, causing failing health checks and an increase in service restarts.