Telerivet incident

Datacenter connectivity issue

Minor Resolved View vendor source →

Telerivet experienced a minor incident on December 31, 2015, lasting 2d 4h. The incident has been resolved; the full update timeline is below.

Started
Dec 31, 2015, 12:44 PM UTC
Resolved
Jan 02, 2016, 05:02 PM UTC
Duration
2d 4h
Detected by Pingoru
Dec 31, 2015, 12:44 PM UTC

Update timeline

  1. identified Dec 31, 2015, 12:44 PM UTC

    Telerivet's primary data center is again experiencing DDoS attacks ( http://status.linode.com/incidents/5ryq5w4l2mfj ), so we have relocated Telerivet to another data center. Some functionality (full-text search, dynamic groups, and SMPP connections) is currently unavailable in the new data center, and we are working to restore those services.

  2. monitoring Dec 31, 2015, 04:35 PM UTC

    All services are currently operational in Telerivet's secondary data center. Search, dynamic groups, Android real-time connections, and SMPP connections are now working, with the exception of a small number of SMPP connections where the mobile network or aggregator requires a particular IP address in our primary data center. As the primary data center remains under DDoS attack at this time, Telerivet will remain in the secondary data center for now.

  3. monitoring Dec 31, 2015, 11:02 PM UTC

    Linode has published an update about the DDoS attacks at http://status.linode.com/incidents/mmdbljlglnfd

  4. monitoring Jan 01, 2016, 02:32 PM UTC

    Due to DDoS attacks in the secondary data center, Telerivet has returned to the primary data center, and most services are operational. Search and dynamic groups are temporarily unavailable while we rebuild the index. All SMPP connections should be working now.

  5. monitoring Jan 01, 2016, 04:23 PM UTC

    Search and dynamic groups are now available, and all Telerivet services are operational.

  6. resolved Jan 02, 2016, 05:02 PM UTC

    This incident has been resolved.