Remarkety experienced a minor incident on December 7, 2021 affecting Web Application and Automations and 1 more component, lasting 11h 31m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Dec 07, 2021, 06:26 PM UTC
We are currently experiencing various issues due to an AWS outage. This outage is currently impacting: - Uploading and downloading files - Sending newsletters via email and SMS We are further assessing the impact on other parts of the system.
- identified Dec 07, 2021, 06:54 PM UTC
We have identified an additional impact on email and SMS links, which intermittently lead to a "504 Gateway Time-out" page. This is again due to the same AWS outage (https://www.theverge.com/2021/12/7/22822332/amazon-server-aws-down-disney-plus-ring-outage). To clarify, AWS is Amazon's cloud, which powers a large part of the internet, as well as Remarkety's own servers. Our application relies on several AWS services for hosting, files, as well as link redirection.
- identified Dec 07, 2021, 09:52 PM UTC
We are seeing improvement in link redirection and overall app performance. However, AWS has not fully resolved the outage and so our engineering team is still monitoring.
- monitoring Dec 07, 2021, 10:19 PM UTC
AWS has updated that a fix has been implemented on their end. Although not officially resolved, we have been seeing normal application performance for the past 2 hours. We are continuing to monitor the system.
- resolved Dec 08, 2021, 05:58 AM UTC
The underlying infrastructure issue has been fully resolved, and the system is operating normally.