Abusix incident
Issues regarding AbuseHQ instances on the US environment
Abusix experienced a major incident on December 7, 2021 affecting Web Application and REST API and 1 more component, lasting 3h 38m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 07, 2021, 04:05 PM UTC
Seems like there are issues with the US AWS region. We are investigating.
- investigating Dec 07, 2021, 04:12 PM UTC
Comments on twitter and reddit lead us to believe there is a major AWS issue for the region. We will continue looking into the issue and try to solve as soon as possible.
- identified Dec 07, 2021, 04:43 PM UTC
AWS provided some information about the underlying issue: " 8:02 AM PST: We have confirmed an operational event in the US-EAST-1 Region, which is definitely affecting the console and other services. This issue is also affecting our monitoring systems which is why we do not have more specifics on the impact beyond the console. We have all teams engaged and are actively working on identifying the root cause. 8:10 AM PST: We have identified the root cause of the issues in the US-EAST-1 Region, which is a network issue with some network devices in that Region which is affecting multiple services, including the console but also services like S3. We are actively working towards recovery. "
- identified Dec 07, 2021, 07:29 PM UTC
AWS says they "are starting to see some signs of recovery." And they "do not have an ETA for full recovery at this time."
- resolved Dec 07, 2021, 07:43 PM UTC
We are now seeing our internal monitoring checks succeed again. If you still notice anything, please let us know via support chat/email.