Multiple Services | South Africa Central (Johannesburg)

Update timeline

1. monitoring Mar 15, 2024, 01:17 AM UTC

   Due to a series of Internet Service Provider (ISP) cable impacts in the South Africa Central (Johannesburg) region, Oracle Cloud Infrastructure (OCI) customers may experience connectivity issues or increased network latency when performing operations within their OCI services. Internet health in the region has been impacted by multiple fiber cuts, which have resulted in an overall reduction of network capacity. The affected ISPs have rerouted traffic to alternate paths to reduce the impact of this issue, and Oracle engineers continue to engage with these providers to determine the next steps towards full resolution. Customer Impact: Customers may experience increased network latency or connectivity failures for their OCI service operations. Our service health monitoring shows that the majority of this impact has been resolved, however customers may continue to experience transient network connectivity issues. We are working on adding more capacity and we anticipate that these steps will help further with ongoing capacity bottleneck. The estimated time of completion for this activity is 19:00 UTC on 15 March 2024. Further updates will be provided as events warrant. Start Time : March 14, 2024 18:09 UTC Reference Number: f71b92e7

2. monitoring Mar 15, 2024, 11:19 PM UTC

   Oracle network infrastructure engineers continue to work alongside ISP teams to complete the provisioning of additional network capacity, which will improve network performance in the South Africa Central (Johannesburg) region. Teams are conducting the necessary testing and validation to bring the capacity online in a healthy operational state. Additional updates will be provided as new information becomes available. Customer Impact: Due to a series of fiber cuts affecting network capacity in the South Africa Central (Johannesburg) region, customers may experience increased network latency or connectivity failures for their OCI service operations. Our service health monitoring shows that the majority of this impact has been resolved, however customers may continue to experience transient network connectivity issues. Further updates will be provided as events warrant. Start Time : March 14, 2024 18:09 UTC Reference Number: f71b92e7

3. monitoring Mar 16, 2024, 04:50 AM UTC

   Oracle network infrastructure engineers continue to work alongside ISP teams to complete the provisioning of additional network capacity and confirm that one of the links is stable, which will improve network performance in the South Africa Central (Johannesburg) region. Teams are conducting the necessary testing and validation to bring the capacity online in a healthy operational state. Additional updates will be provided as new information becomes available. Customer Impact: Customer Impact: Due to a series of fibre cuts affecting network capacity in the South Africa Central (Johannesburg) region, customers may experience increased network latency or connectivity failures for their OCI service operations. Our service health monitoring shows that the majority of this impact has been resolved; however, customers may continue to experience transient network connectivity issues. Further updates will be provided as events warrant. Start Time : March 14, 2024 18:09 UTC Reference Number: f71b92e7

4. monitoring Mar 16, 2024, 09:08 PM UTC

   Oracle network infrastructure engineers have completed provisioning additional network capacity and have confirmed that links are stable. Network traffic flow has been verified to be healthy. However, the Oracle Health Check (OHC) service may still be missing public telemetry data/logs. Our engineers are continuing to perform additional backend refinements to resolve this issue. Additional updates will be provided as new information becomes available. Customer Impact: Some OHC customers who rely on OCI metrics-based alarms may not have their alarms working due to public telemetry data/logs being unavailable. All other functions/features of OHC are working at this time. Further updates will be provided as events warrant. Start Time : March 14, 2024 18:09 UTC Reference Number: f71b92e7

5. monitoring Mar 17, 2024, 11:27 PM UTC

   Oracle infrastructure engineers have identified a recurrence of network traffic degradation while monitoring service performance. This recurrence is stemming from a series of fiber cuts affecting network capacity in the South Africa Central (Johannesburg) region. Teams are applying additional backend adjustments to mitigate the impact and will continue to closely monitor service health. Additional updates will be provided as new information becomes available. Customer Impact: Affected customers may be experiencing increased network latency or connectivity failures for their OCI service operations, such as Create, Read, Update, and Delete (CRUD) service management operations. Our service health monitoring currently shows that the majority of this impact has been resolved. However, some customers may continue to experience transient network connectivity issues. Further updates will be provided as events warrant. Start Time : March 14, 2024 18:09 UTC Reference Number: f71b92e7

6. resolved Mar 21, 2024, 10:24 PM UTC

   We've validated that, following the capacity add in South Africa Central (Johannesburg) and further networking adjustments made by OCI engineers, network performance has remained stable for OCI services since March 19, 2024 at 15:34 UTC. Service functionality and network stability have been restored. OCI service teams will continue to closely monitor service health while ISPs continue their work to fully repair all fiber issues in the region. Customer Impact: Affected customers experienced increased network latency or connectivity failures for their OCI service operations, such as Create, Read, Update, and Delete (CRUD) service management operations. Our service health monitoring showed that the majority of this impact was resolved on March 14, 2024, however some customers may have continued to experience transient connectivity issues until additional network capacity was confirmed to be operationally ready and stable on March 19. Further updates will be provided as events warrant. Start Time : March 14, 2024 18:09 UTC End Time : March 19, 2024 15:34 UTC Reference Number: f71b92e7