Reinvent Telecom incident

Metaswitch Connectivity

Notice Resolved View vendor source →

Reinvent Telecom experienced a notice incident on October 31, 2022 affecting Call Recording and Bandwidth and 1 more component, lasting 1d 1h. The incident has been resolved; the full update timeline is below.

Started
Oct 31, 2022, 06:30 PM UTC
Resolved
Nov 01, 2022, 07:50 PM UTC
Duration
1d 1h
Detected by Pingoru
Oct 31, 2022, 06:30 PM UTC

Affected components

Call RecordingBandwidthInbound NationalOutbound NationalSMSFax ServicesToll-FreeToll-FreeMMSSinch

Update timeline

  1. investigating Oct 31, 2022, 06:30 PM UTC

    We are currently investigating this issue.

  2. investigating Oct 31, 2022, 07:08 PM UTC

    We continue to work with Metaswitch and see switch devices back in service and links established. Call volume has increased during the last 15 minutes from 1000 calls to over 3000 calls and continuing to grow, suggesting gradual restoral of services.

  3. investigating Oct 31, 2022, 07:32 PM UTC

    We continue to work with Metaswitch and see switch devices back in service and links established. Call volume has increased to 75% of calls and continuing to grow. Checking Enhanced Application Server as we are receiving feedback that there are issues. We have call examples and investigating.

  4. investigating Oct 31, 2022, 08:25 PM UTC

    We are working with Metaswitch to reduce the traffic to the Call Feature Server in order to allow the Call Feature server to recover. EAS is affected because of the CFS traffic volume and therefore the focus on the CFS traffic.

  5. investigating Oct 31, 2022, 09:11 PM UTC

    Switching network has stablized after several changes, and Metaswitch has e-fix is urgent and will be implanted tonight during the maintenance window.

  6. investigating Oct 31, 2022, 09:11 PM UTC

    We are continuing to investigate this issue.

  7. monitoring Oct 31, 2022, 09:28 PM UTC

    Changing status to monitoring as e-fix will be applied tonight during maintenance window.

  8. resolved Nov 01, 2022, 07:50 PM UTC

    At this time we continue to show stability on the Metaswitch Network and no new issues have been reported. A preliminary RFO will be provided shortly. If any new issues occur please contact the NOC. Thank you for your patience.