SearchStax incident

False Heartbeat Alerts Triggered

Notice Resolved View vendor source →

SearchStax experienced a notice incident on October 13, 2023 affecting Pulse Monitoring, lasting 17h 6m. The incident has been resolved; the full update timeline is below.

Started
Oct 13, 2023, 04:12 AM UTC
Resolved
Oct 13, 2023, 09:19 PM UTC
Duration
17h 6m
Detected by Pingoru
Oct 13, 2023, 04:12 AM UTC

Affected components

Pulse Monitoring

Update timeline

  1. identified Oct 13, 2023, 04:12 AM UTC

    We have discovered false Heartbeat alerts for several deployments starting October 12, 2023, 23:21 UTC. Our team is investigating the issue and identified a possible connectivity issue. Our team has separate monitoring that is set up for all deployments for which they get alerted if a node or deployment is unavailable. At this time, we checked all alerts triggered via Pulse and have confirmed that the deployments for which these alerts were triggered are all in a healthy state.

  2. monitoring Oct 13, 2023, 02:28 PM UTC

    The connectivity issue has been resolved and all Monitoring Agents are able to communicate with the Pulse Service. We will continue monitoring this issue.

  3. resolved Oct 13, 2023, 09:19 PM UTC

    This incident has been resolved.