Crunch.io incident

Database availability interrupted

Major Resolved View vendor source →

Crunch.io experienced a major incident on October 29, 2020 affecting Crunch.io Web Application and API and Dataset Streaming, lasting 1d 1h. The incident has been resolved; the full update timeline is below.

Started
Oct 29, 2020, 08:13 PM UTC
Resolved
Oct 30, 2020, 09:39 PM UTC
Duration
1d 1h
Detected by Pingoru
Oct 29, 2020, 08:13 PM UTC

Affected components

Crunch.io Web Application and APIDataset Streaming

Update timeline

  1. investigating Oct 29, 2020, 08:13 PM UTC

    We are currently investigating an interruption in database availability.

  2. monitoring Oct 29, 2020, 08:21 PM UTC

    The number of database processes dropped precipitously during a routine maintenance operation. It has recovered, and we are investigating why they became unavailable.

  3. investigating Oct 29, 2020, 08:32 PM UTC

    The system has partially recovered but some datasets are still being routed to invalid database processes.

  4. monitoring Oct 29, 2020, 09:01 PM UTC

    We are still investigating the root cause, but normal availability has been restored.

  5. resolved Oct 30, 2020, 09:39 PM UTC

    The temporary database disruption was resolved as of 16:51 EDT Thursday, with the root cause(s) still being analyzed.