Commio incident

Inbound & Outbound Voice

Major Resolved View vendor source →

Commio experienced a major incident on January 24, 2022 affecting Commio Portal and Inbound Voice and 1 more component, lasting 30m. The incident has been resolved; the full update timeline is below.

Started
Jan 24, 2022, 08:00 PM UTC
Resolved
Jan 24, 2022, 08:30 PM UTC
Duration
30m
Detected by Pingoru
Jan 24, 2022, 08:00 PM UTC

Affected components

Commio PortalInbound VoiceOutbound VoiceText Messaging (SMS/MMS)Caller Name (CNAM)Local Routing Number (LRN)Voice APIs

Update timeline

  1. investigating Jan 24, 2022, 08:09 PM UTC

    We are currently experiencing a service issue that is affecting inbound/outbound calling, CNAM, LRN, messaging, and the thinQ.io portal. We're hard at work on the issue. More details will be provided here as we research the issue and understand a resolution timeline. Stay tuned. Please ask partners to send a ticket to [email protected] to get the latest information, and invite them to monitor service status via: status.thinq.com

  2. investigating Jan 24, 2022, 08:15 PM UTC

    We are continuing to investigate this issue. More details will be provided here as we research the issue and understand a resolution timeline. Stay tuned. Please ask partners to send a ticket to [email protected] to get the latest information, and invite them to monitor service status via: status.thinq.com

  3. monitoring Jan 24, 2022, 08:35 PM UTC

    Our engineers have implemented a fix, and we are seeing services being restored to normal operation. Stay tuned. Send a ticket to [email protected] to get the latest information, and monitor service status via: status.thinq.com

  4. resolved Jan 24, 2022, 08:37 PM UTC

    Our engineers have resolved the intermittent service issue that was affecting inbound/outbound calling, CNAM, LRN, messaging, and the thinQ.io portal. We have been monitoring our network and have verified stability. We’re truly sorry for the impact this has had on your business, and any stress and frustration it has caused you personally. We hope that our transparency shows our commitment to you and all of our partners. Thank you.

  5. postmortem Jan 25, 2022, 03:43 PM UTC

    Yesterday, Commio was targeted by a Denial of Service \(DoS\) attack that impacted our voice, messaging, and database services. Service was impacted intermittently for approximately 30 minutes starting at 3PM EST / 12PM PST / 8PM UTC. As you may know, others in our industry have also experienced similar attacks. Our network was protected from a sustained service interruption by our Cloudflare Magic Transit installation. This always-on, network-level protection gives our network the added capacity and automated DDoS mitigation systems we need to secure your communications. Our systems detected the attack, then were able to address the intrusion. However, there are systematic delays in the ability to identify, then mitigate. Customers may have experienced intermittent issues during this short period. Our team, infrastructure, and investment into DDoS mitigation solutions shows our commitment to all of our customers and partners that we are serious in addressing any and all service disruptions, including those caused by malicious DDoS/DoS attacks. **Technical Updates & Alerts** To add team members to our technical updates email list, [click here](https://better.thinq.com/email-signup-page). Connect to our [status page](https://status.thinq.com) to sign up for live text alerts from our network operations center. If you have questions or concerns, please reach out to your customer success specialist: Phone: \(919\) 890-0000, option 1 Email: [[email protected]](mailto:[email protected])