SchoolData.net experienced a major incident on February 28, 2017, lasting 3h 52m. The incident has been resolved; the full update timeline is below.
Update timeline
- identified Feb 28, 2017, 06:25 PM UTC
Amazon Web Services is currently experiencing issues of "high error rates" with their S3 service which is causing issues with other services. This Amazon issue is breaking some upload services in our applications and is preventing some emails from being delivered. More info from Amazon: https://status.aws.amazon.com/
- identified Feb 28, 2017, 08:05 PM UTC
Amazon Web Services continues to have issues with services in their US-EAST-1 region. As of this posting, there are 39 AWS services that are experiencing operational issues. School Data Solutions relies on SES and S3 which are included in their list of services that are affected - this will affect file uploading, file downloading, report generation, data grid generation, email notifications, image asset loading, and more. This AWS outage also affects our help desk system, Zendesk. If you are having issues submitting a ticket and need immediate assistance, please call us at 509-688-9536.
- identified Feb 28, 2017, 09:20 PM UTC
Amazon is seeing recovery for S3 retrievals, listings, and deletions. This means file downloads will begin to work but may be spotty - please try again if your first attempt does not work. S3 uploading is still not working which means reports, data grids, various uploads, and other files generations will still not work.
- resolved Feb 28, 2017, 10:17 PM UTC
Amazon S3 is fully operational again. File generation is working and email notifications are now being sent.