SearchStax incident

High Error rate on Analytics and Pulse APIs

Minor Resolved View vendor source →

SearchStax experienced a minor incident on September 15, 2020, lasting —. The incident has been resolved; the full update timeline is below.

Started
Sep 15, 2020, 03:00 AM UTC
Resolved
Sep 15, 2020, 03:00 AM UTC
Duration
Detected by Pingoru
Sep 15, 2020, 03:00 AM UTC

Update timeline

  1. resolved Sep 22, 2020, 09:01 PM UTC

    From September 15 3:16am PT UTC to 3:41am UTC, there was an elevated rate of 500-level responses for the Analytics and Pulse API requests. During the incident window, impacted API calls to authenticated endpoints received HTTP 5xx and/or timeout responses. Due to the 5XX errors on Analytics APIs, there could be some analytics data that is missed for your application for the duration of the incident. There were also a number of False Heartbeat alerts that were sent out because of the failing Pulse API requests. If your deployment was affected by this, our team is taking measures to fix the false alerts.