RevOps Outage History

We have discovered and fixed the root cause of this issue. It appears that there was a change to a 3rd party library that was causing our security to deny service. This has been fixed and HubSpot iframe users should all now be able to use CPQ as usual.

We have rolled out a fix for the issue and are seeing improvements in error rates

A change in our platform appears to be the root cause of the service degradation. We have rolled back the change and we are seeing a reduction in error rates. We will continue to monitor and update any impacted deals or other platform resources.

PDF Generation and all other background jobs have stabilized and are performing with no issues now. We are also aware of issues with Slack and email notifications not being received, this is related to incidents from upstream providers. While Slack notification error rates are decreasing, email notification error rates are no long increasing. We will continue to monitor these services. We are beginning investigation of impacted deals and failed notifications, and will update deals and resend notifications. If you are missing expected notifications, you will begin to receive them shortly.

We've identified impact and have rolled over services to a stable backup region. We are beginning to see reduction in error rates for these services. We will continue monitoring as this event continues.

Services are fully operational and PDF generations, CRM syncs, and notifications are completing as expected. We will continue to monitor the services as we work through the reprocessing of previously failed operations.

Services are fully restored and CRM syncs are being reprocessed automatically.

Our upstream hosting provider is experiencing an unexpected outage, which is causing complete unavailability of our public website (https://www.revops.io). The outage originates from the third-party provider and was outside of our direct control. We are monitoring and will update as availability improves. All other areas of the RevOps platform are fully operational.

We are starting to see our public website load intermittently. Our upstream hosting provider is still reporting "Degraded Performance" on their side. We continue to monitor and will update as availability improves. All other areas of the RevOps platform are fully operational. If you need help or have questions about RevOps, feel free to send them to [email protected]

Despite our upstream hosting provider still reporting "Degraded Performance" on their side, we are seeing great improvement in availability for the RevOps public website. We will continue to monitor and update as availability improves. All other areas of the RevOps platform are fully operational. If you need help or have questions about RevOps, feel free to send them to [email protected]

Our upstream provider is now reporting "Fully Operational", and we are seeing the same, we are fully operational now. If you need help or have questions about RevOps, feel free to send them to [email protected]

Our platform services are starting to recover. We may encounter sporadic failures until full service recovery.

Internal testing indicates that Platform services are nearing full recovery for most customers. We are still monitoring and updates from our upstream infrastructure provider before confirming final resolution.

Our upstream infrastructure service provider has confirmed full service recovery for most services. A few services are still seeing some residual impact and recovery is expected to be complete in less than hour.

Services are restored and the marketing website is accessible again. We are continuing to monitor resolution status.