Splunk OnCall incident

Splunk On-Call Portal Unavailable on Web and Mobile - Still Ingesting Alerts & Notifications

Major Resolved View vendor source →

Splunk OnCall experienced a major incident on June 4, 2025 affecting Web Client (Portal) and Android Client - Mobile App and 1 more component, lasting 1h 49m. The incident has been resolved; the full update timeline is below.

Started
Jun 04, 2025, 07:55 AM UTC
Resolved
Jun 04, 2025, 09:45 AM UTC
Duration
1h 49m
Detected by Pingoru
Jun 04, 2025, 07:55 AM UTC

Affected components

Web Client (Portal)Android Client - Mobile AppiOS Client - Mobile App

Update timeline

  1. investigating Jun 04, 2025, 07:55 AM UTC

    The Splunk On-Call portal is currently unavailable via web and mobile. We are actively working to resolve this issue as quickly as possible. If you have any immediate questions or concerns, our support team is standing by to respond: 1 (855) 775-8657 https://help.victorops.com/knowledge-base/how-to-contact-splunk-on-call-support/

  2. identified Jun 04, 2025, 08:27 AM UTC

    We've identified this issue related to a deploy inadvertently impacting our databases and are working to stabilize. The Web Client is coming back on line now. Thank you for your patience while we coming back on line.

  3. monitoring Jun 04, 2025, 08:36 AM UTC

    Update: A fix has been implemented and we are monitoring the issue. The On-Call timeline is still experiencing loading issues. We are seeing high alert-lag across the platform.

  4. monitoring Jun 04, 2025, 08:56 AM UTC

    We continue to monitor the situation. We are still experiencing high alert lag. The Web Client and Mobile Apps are now accessible. Thanks for your patience while we continue to work this issue to resolution.

  5. resolved Jun 04, 2025, 09:45 AM UTC

    This incident is now resolved. The Splunk On-Call web client and mobile applications are fully operational. We apologize for the inconvenience. Please reach out to the Splunk On-Call support team with any questions. https://help.splunk.com/en/splunk-observability-cloud/splunk-on-call/introduction-to-splunk-on-call/getting-started-guide-for-splunk-on-call-admins/contact-splunk-on-call-support