Technolutions experienced a notice incident on May 4, 2021 affecting Slate, lasting 4h 12m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 04, 2021, 08:45 PM UTC
We will be performing maintenance on the EROS database cluster this evening with the intent to address some intermittent availability issues observed today for databases on this cluster. This maintenance will occur overnight and will seek to minimize any potential for downtime. We will also take this opportunity to apply the latest vendor service updates for this cluster in an intent to further improve system stability.
- investigating May 04, 2021, 09:04 PM UTC
We're restarting the cluster service right now on EROS in attempt to provide more immediate remedy to the availability issues observed. We will continue to proceed with the additional maintenance overnight or as updated.
- resolved May 05, 2021, 12:58 AM UTC
The cluster service restart earlier appears to have addressed the intermittent availability issues observed. We have updated the secondary nodes in the high availability clusters, but we're going to hold off on updating the primary nodes for three reasons. First, the service restart appears to have addressed the immediate issues. Second, out of an abundance of caution, we would like to monitor further this latest vendor service update and its impacts on secondary nodes before updating primary nodes. Third, we are expecting the availability of a new vendor service update in the coming days or weeks, and we would like to ensure that release notes for this forthcoming update do not reveal any major issues in the current service update. Performance and availability of all database clusters is one of our highest priorities, and we believe this measured approach to the most prudent course of action at this time. As always, we'll continue to monitor all systems and will address any issues if they arise.