Treasure Data incident

[US Region] Delays in Processing incoming events

Minor Resolved View vendor source →

Treasure Data experienced a minor incident on June 26, 2024 affecting Streaming Import REST API and Mobile/Javascript REST API and 1 more component, lasting 1h. The incident has been resolved; the full update timeline is below.

Started
Jun 26, 2024, 02:43 AM UTC
Resolved
Jun 26, 2024, 03:43 AM UTC
Duration
1h
Detected by Pingoru
Jun 26, 2024, 02:43 AM UTC

Affected components

Streaming Import REST APIMobile/Javascript REST APICDP Personalization - Ingest APIADL

Update timeline

  1. investigating Jun 26, 2024, 02:43 AM UTC

    We are monitoring delays in systems responsible for processing incoming ingested events using our ingestion API. There also increased errors in the ingestion API. The delay is caused by infrastructure issues in our provider, which are currently being addressed. We are monitoring the situation. During this time, writing to storage may be delayed, but there is no evidence of data loss.

  2. monitoring Jun 26, 2024, 02:43 AM UTC

    We are in constant communication with our service provider.

  3. resolved Jun 26, 2024, 03:43 AM UTC

    The issue is resolved at the provider and all components have completed catch-up.