Keen incident

Write path experiment

Minor Resolved View vendor source →

Keen experienced a minor incident on July 2, 2016 affecting Stream API, lasting 9h 29m. The incident has been resolved; the full update timeline is below.

Started
Jul 02, 2016, 07:54 PM UTC
Resolved
Jul 03, 2016, 05:24 AM UTC
Duration
9h 29m
Detected by Pingoru
Jul 02, 2016, 07:54 PM UTC

Affected components

Stream API

Update timeline

  1. scheduled Jul 02, 2016, 07:54 PM UTC

    We will be temporarily disabling the process which loads new events into our database for querying. New events may not show up in query results for up to 30 minutes during this time. The events will still be processed normally, just delayed. The purpose of this experiment is to test some hypotheses about performance characteristics that we have observed while analyzing our recent incident (http://status.keen.io/incidents/6jr01np96s1h).

  2. in progress Jul 03, 2016, 05:02 AM UTC

    During this testing there may be a delay of up to 30 minutes before events are available for querying. The events will NOT be lost, just delayed. Thanks for bearing with us.

  3. completed Jul 03, 2016, 05:24 AM UTC

    Experiment completed; all services back to normal. We got some good data! Thanks for your patience.