- Detected by Pingoru
- May 01, 2026, 03:14 PM UTC
- Resolved
- May 01, 2026, 07:42 PM UTC
- Duration
- 4h 28m
Affected: US - Job Processing
Timeline · 4 updates
-
investigating May 01, 2026, 03:14 PM UTC
We are currently investigating this issue.
-
investigating May 01, 2026, 04:22 PM UTC
We are still actively troubleshooting this issue.
-
monitoring May 01, 2026, 06:31 PM UTC
A fix has been implemented, and we are currently monitoring the results.
-
resolved May 01, 2026, 07:42 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Mar 01, 2026, 02:58 PM UTC
- Resolved
- Mar 02, 2026, 07:44 AM UTC
- Duration
- 16h 45m
Affected: US - Web ApplicationUS - GraphQL API
Timeline · 9 updates
Read the full incident report →
- Detected by Pingoru
- Mar 01, 2026, 06:00 AM UTC
- Resolved
- Mar 01, 2026, 10:47 AM UTC
- Duration
- 4h 46m
Affected: US - Web ApplicationUS - GraphQL API
Timeline · 5 updates
-
investigating Mar 01, 2026, 06:00 AM UTC
We are currently investigating this issue.
-
investigating Mar 01, 2026, 07:22 AM UTC
We are still investigating the root cause of application slowness and increased error rate affecting US data center.
-
investigating Mar 01, 2026, 08:09 AM UTC
We are monitoring partial recovery of the application in the US datacenter. Investigation into the root cause is ongoing.
-
investigating Mar 01, 2026, 09:32 AM UTC
The root cause has been identified and a fix applied. The system is entering full recovery.
-
resolved Mar 01, 2026, 10:47 AM UTC
Application health is now back to normal.
Read the full incident report →
- Detected by Pingoru
- Feb 26, 2026, 03:32 PM UTC
- Resolved
- Feb 26, 2026, 08:08 PM UTC
- Duration
- 4h 36m
Affected: US - Web ApplicationUS - GraphQL API
Timeline · 5 updates
-
investigating Feb 26, 2026, 03:32 PM UTC
We are currently investigating this issue.
-
investigating Feb 26, 2026, 04:46 PM UTC
We have made changes and saw some improvements with latency. We are still investigating this issue.
-
investigating Feb 26, 2026, 06:23 PM UTC
We are continuing to investigate this issue.
-
monitoring Feb 26, 2026, 07:04 PM UTC
The issue has been identified, and a fix has been implemented. Currently monitoring the results.
-
resolved Feb 26, 2026, 08:08 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Feb 19, 2026, 04:00 PM UTC
- Resolved
- Feb 20, 2026, 02:15 AM UTC
- Duration
- 10h 15m
Affected: CA - Web Application
Timeline · 3 updates
-
investigating Feb 19, 2026, 04:00 PM UTC
We are currently experiencing an issue with the Auth0 SSO/SAML connection on the CA DC. Development has identified the issue and is working on a solution at this time.
-
monitoring Feb 19, 2026, 04:53 PM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Feb 20, 2026, 02:15 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Feb 03, 2026, 11:44 PM UTC
- Resolved
- Feb 04, 2026, 01:11 AM UTC
- Duration
- 1h 26m
Affected: US - Web ApplicationUS - Job ProcessingUS - GraphQL APIUS - Scheduled EventsUS - Netflow Processors
Timeline · 2 updates
-
investigating Feb 03, 2026, 11:44 PM UTC
We are currently investigating this issue. We are seeing an increase in nginx errors at this time.
-
resolved Feb 04, 2026, 01:11 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Dec 30, 2025, 08:42 PM UTC
- Resolved
- Dec 31, 2025, 12:04 AM UTC
- Duration
- 3h 22m
Affected: ippay
Timeline · 4 updates
-
investigating Dec 30, 2025, 08:42 PM UTC
We are seeing an increase in IPPay connection failures. We have reached out to IPPay, as we see 20% of the connections fail with IPPay.
-
investigating Dec 30, 2025, 10:32 PM UTC
IPPay is still investigating at this time. If you experience any failed payments, if you attempt another payment, this will most likely be successful. The current failure rate is 20 to 30% for IPPay. No other payment processors are impacted.
-
monitoring Dec 30, 2025, 11:21 PM UTC
As of 3:30pm CST, we stopped seeing IPPay failures. We are currently monitoring at this time.
-
resolved Dec 31, 2025, 12:04 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Dec 16, 2025, 06:19 PM UTC
- Resolved
- Dec 16, 2025, 07:58 PM UTC
- Duration
- 1h 39m
Affected: US - Looker
Timeline · 3 updates
-
identified Dec 16, 2025, 06:19 PM UTC
Reporting is currently delayed in updates due to a vendor issue. We have identified the issue and are working with the vendor to resolve this issue.
-
monitoring Dec 16, 2025, 07:24 PM UTC
A fix has been implemented, and we are monitoring the results.
-
resolved Dec 16, 2025, 07:58 PM UTC
This incident has been resolved.
Read the full incident report →
Critical December 11, 2025 - Detected by Pingoru
- Dec 11, 2025, 06:17 AM UTC
- Resolved
- Dec 11, 2025, 01:59 PM UTC
- Duration
- 7h 41m
Affected: US - Web ApplicationUS - Job ProcessingUS - GraphQL APIUS - Scheduled EventsUS - Netflow Processors
Timeline · 4 updates
-
investigating Dec 11, 2025, 11:43 AM UTC
We are currently investigating this issue.
-
identified Dec 11, 2025, 11:57 AM UTC
The issue has been identified, and a fix is being implemented.
-
monitoring Dec 11, 2025, 12:55 PM UTC
A fix has been implemented, and we are monitoring the results.
-
resolved Dec 11, 2025, 01:59 PM UTC
This incident has been resolved.
Read the full incident report →
Critical December 1, 2025 - Detected by Pingoru
- Dec 01, 2025, 09:51 AM UTC
- Resolved
- Dec 01, 2025, 07:53 PM UTC
- Duration
- 10h 2m
Affected: US - Web ApplicationUS - Job ProcessingUS - GraphQL APIUS - Scheduled Events
Timeline · 11 updates
Read the full incident report →
- Detected by Pingoru
- Nov 18, 2025, 02:54 PM UTC
- Resolved
- Nov 18, 2025, 03:09 PM UTC
- Duration
- 15m
Affected: US - sonarPayUS - sonarPay Management Portal
Timeline · 4 updates
-
identified Nov 18, 2025, 02:54 PM UTC
We are currently experiencing degraded performance with sonarPay due to ongoing issues with Cloudflare. As a result, there may be difficulties when processing payments or adding/updating payment methods. We’re actively monitoring the situation and will provide updates as they become available.
-
identified Nov 18, 2025, 02:55 PM UTC
We are continuing to monitor.
-
monitoring Nov 18, 2025, 03:03 PM UTC
Cloudflare has implemented a fix and we are seeing improvement. We will continue to monitor.
-
resolved Nov 18, 2025, 03:09 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Oct 03, 2025, 03:51 PM UTC
- Resolved
- Oct 03, 2025, 05:33 PM UTC
- Duration
- 1h 42m
Affected: US - Job Processing
Timeline · 6 updates
-
investigating Oct 03, 2025, 04:20 PM UTC
We are currently experiencing a delay in webhook processing and are actively investigating.
-
identified Oct 03, 2025, 04:21 PM UTC
The issue has been identified and a fix is being implemented.
-
monitoring Oct 03, 2025, 04:27 PM UTC
A fix has been implemented and we are monitoring the results.
-
monitoring Oct 03, 2025, 04:37 PM UTC
The webhook queue is beginning to recover. We are continuing to monitor.
-
monitoring Oct 03, 2025, 05:00 PM UTC
The webhook queue is continuing to recover. We are continuing to monitor.
-
resolved Oct 03, 2025, 05:33 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Sep 03, 2025, 02:29 PM UTC
- Resolved
- Sep 03, 2025, 06:27 PM UTC
- Duration
- 3h 58m
Affected: US - Web ApplicationUS - GraphQL API
Timeline · 3 updates
-
investigating Sep 03, 2025, 02:29 PM UTC
We are currently investigating this issue.
-
monitoring Sep 03, 2025, 03:34 PM UTC
A fix has been implemented, and we are monitoring.
-
resolved Sep 03, 2025, 06:27 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Aug 22, 2025, 06:20 PM UTC
- Resolved
- Aug 22, 2025, 09:30 PM UTC
- Duration
- 3h 9m
Affected: US - Job Processing
Timeline · 4 updates
-
investigating Aug 22, 2025, 06:20 PM UTC
We are currently investigating this issue.
-
identified Aug 22, 2025, 07:04 PM UTC
The issue has been identified, and a fix has been implemented.
-
monitoring Aug 22, 2025, 08:03 PM UTC
A fix has been implemented, and we are monitoring the results.
-
resolved Aug 22, 2025, 09:30 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Aug 13, 2025, 06:17 PM UTC
- Resolved
- Aug 13, 2025, 08:05 PM UTC
- Duration
- 1h 48m
Affected: Mandrill Email Processing
Timeline · 3 updates
-
investigating Aug 13, 2025, 06:17 PM UTC
An upstream SSL/TLS certificate was unexpectedly revoked by our certificate vendor during their investigation of a Certificate Authority issue. We promptly reissued a new SSL certificate, but inbound HTTPS connections from Mandrill are now failing TLS validation because Mandrill has not yet updated to the correct CA root. We are actively coordinating with both the certificate provider and Mandrill to restore normal service.
-
monitoring Aug 13, 2025, 07:08 PM UTC
The Certificate Authority has implemented a fix. Mandrill is currently processing a backlog of emails to Sonar, and deliveries may be delayed by up to 10 minutes while the Mandrill backlog queue clears.
-
resolved Aug 13, 2025, 08:05 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Aug 11, 2025, 09:10 PM UTC
- Resolved
- Aug 11, 2025, 10:28 PM UTC
- Duration
- 1h 18m
Affected: Mandrill Email Processing
Timeline · 3 updates
-
investigating Aug 11, 2025, 09:10 PM UTC
We are investigating an issue affecting the delivery of inbound emails to Sonar. Our team has engaged Mandrill for support in resolving this matter.
-
monitoring Aug 11, 2025, 09:44 PM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Aug 11, 2025, 10:28 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Aug 01, 2025, 06:00 AM UTC
- Resolved
- Aug 01, 2025, 07:27 AM UTC
- Duration
- 1h 27m
Affected: US - Web ApplicationUS - GraphQL API
Timeline · 3 updates
-
investigating Aug 01, 2025, 06:00 AM UTC
We are currently experiencing high latency for Sonar in the US.
-
monitoring Aug 01, 2025, 06:47 AM UTC
Sonar application has stabilized. We are currently monitoring.
-
resolved Aug 01, 2025, 07:27 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Jul 01, 2025, 07:28 AM UTC
- Resolved
- Jul 01, 2025, 08:31 AM UTC
- Duration
- 1h 3m
Affected: US - Web ApplicationUS - GraphQL API
Timeline · 2 updates
-
investigating Jul 01, 2025, 01:57 PM UTC
We experienced a period of degraded performance affecting both the UI and GraphQL API. During this time, users may have encountered slower than normal load times when accessing the application.
-
resolved Jul 01, 2025, 01:57 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Jun 24, 2025, 03:04 PM UTC
- Resolved
- Jun 24, 2025, 05:30 PM UTC
- Duration
- 2h 25m
Affected: US - Web ApplicationUS - GraphQL API
Timeline · 2 updates
-
monitoring Jun 24, 2025, 03:38 PM UTC
We experienced a brief disruption due to unplanned emergency maintenance initiated by Azure on one of our ingress nodes. During this time, connections routed through the affected node experienced timeouts. Our system automatically detected the issue, and nginx began rerouting traffic to healthy nodes. While this mitigated the impact, some users may have experienced momentary connection failures during the transition.
-
resolved Jun 24, 2025, 05:30 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Jun 01, 2025, 04:29 PM UTC
- Resolved
- Jun 01, 2025, 07:31 PM UTC
- Duration
- 3h 1m
Affected: CA - Web ApplicationCA - Job ProcessingCA - GraphQL APICA - Scheduled Events
Timeline · 4 updates
-
investigating Jun 01, 2025, 04:29 PM UTC
We are currently investigating this issue.
-
identified Jun 01, 2025, 04:49 PM UTC
The issue has been identified and currently working on implementing a fix at this time.
-
monitoring Jun 01, 2025, 06:39 PM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Jun 01, 2025, 07:31 PM UTC
This incident has been resolved.
Read the full incident report →