SevenRooms experienced a major incident on January 8, 2021 affecting Elastic Cloud Cluster Connectivity: GCP us-central1 and Elastic Cloud Cluster Connectivity: GCP europe-west1 and 1 more component, lasting 58m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 08, 2021, 06:27 PM UTC
We are currently investigating the issue with our elastic search, as it has temporarily gone down. We will provide everyone with updates at 3pm EST, at the latest.
- monitoring Jan 08, 2021, 06:42 PM UTC
We have restored service to those customers that were impacted by the search being down as of 1:35 EST and are continuing to monitor the root cause.
- resolved Jan 08, 2021, 07:26 PM UTC
An earlier configuration change relieved pressure on the search servers but did not address the root cause. The root cause was identified to be an application change that causes excessive server load on the search servers. This has been patched and we believe the issue to be fully resolved going forward. We will continue to monitor for any further service abnormalities.