Upstream Provider Network Maintenance (RS)

Update timeline

1. investigating Jun 01, 2023, 06:30 AM UTC

   Our upstream provider will be performing network maintenance on June 1, from 01:30CT-0600, CT. This may cause a brief service interruptions to US-hosted Koha partners during that time.

2. monitoring Jun 01, 2023, 11:21 AM UTC

   This mandatory upstream maintenance has gone long, and brief outages are continuing while they work through the remaining issues.

3. monitoring Jun 01, 2023, 12:14 PM UTC

   We are continuing to see issues related to this maintenance, the networking team at our upstream provider is engaged with the problem and we will have an update in another hour. What you can potentially expect during this ongoing issue: - 5-10 minute brief outages where you will receive an 'internal server error' - somewhat reduced overall performance Do feel free to get in touch with us if you have additional questions or concerns.

4. monitoring Jun 01, 2023, 01:44 PM UTC

   The team at our upstream provider advises that they are still working to identify and resolve the networking issues that are causing today's instability. They will have an update again in another hour.

5. monitoring Jun 01, 2023, 02:10 PM UTC

   Good news here - things seem to be stabilizing, and we are monitoring the situation closely and in constant contact with our upstream team. As always if you have questions or concerns, please do get in touch via our ticketing system, slack, or phone.

6. monitoring Jun 01, 2023, 03:23 PM UTC

   Our upstream provider has identified the issue and has implemented a fix, however there is some last mile work that will need to be completed tonight after 7pm central time. Expectation is less than 5 minutes of downtime for a subset of partners. We will mark this as fixed once this last mile maintenance has been completed. Thank you for your patience today as we work together with our upstream partners to work out these issues.

7. resolved Jun 02, 2023, 12:49 AM UTC

   Our upstream provider has completed the last mile maintenance and all services should be fully operational with no systemic performance issues. Please let us know if you have any further questions or concerns!