Splunk OnCall incident
VictorOps Service Disruption with Notifications
Splunk OnCall experienced a minor incident on February 26, 2020 affecting Notifications - SMS and Notifications - Google Push and 1 more component, lasting 1h 47m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 26, 2020, 06:36 PM UTC
We are currently experiencing an isolated service disruption. The effected areas are currently being investigated by our Engineering Team in order to identify the issue and implement a solution. We are actively working to resolve this issue as quickly as possible and we will send an additional update within the next 20 minutes. Use the Subscribe to Updates option or follow @VOSupport on Twitter for updates. If you have any immediate questions or concerns, our support team is standing by via email at [email protected] or submit the form on our Contact Support page (https://victorops.com/contact-support/).
- identified Feb 26, 2020, 06:45 PM UTC
We've identified the issue and are working towards a resolution. We can confirm that off-call push notifications and test phone call notifications are degraded. Thanks for your patience while we sort this out and please stay tuned for further updates.
- identified Feb 26, 2020, 07:35 PM UTC
We are continuing to work on a fix for this issue.
- monitoring Feb 26, 2020, 07:37 PM UTC
A fix is being implemented and we will continue to update you as we monitor the results. To clarify, both Test and On and Off-call notifications are affected.
- resolved Feb 26, 2020, 08:23 PM UTC
Apologies for any inconvenience. This incident has been resolved.