MIT IS&T Outage History

During a planned maintenance window in the Warehouse to support Daylight Savings Time, we experienced an issue with the SAP scheduler, which impacted authorization data. The data in the warehouse is stable, but user access to the data is unavailable at this time. We are working with SAP to correct this issue and re-run authorizations, and we are working to make the data available this afternoon. Please direct any questions about this incident to [email protected].

As of 5:00 p.m., all warehouse data access, with the exception of Edacca access, has been restored to users. Edacca access is currently being restored and will be available soon. Please continue to direct any questions to [email protected].

Microsoft has indicated that a majority of impacted services are recovering following their change. IS&T will keep monitoring until impact has been resolved for all Microsoft services.

Service has been restored to all impacted call centers. IS&T will continue to monitor the situation.

Most issues related to Slack APIs and Workflows should now be resolved; however, Slack continues to monitor issues with mentions and replaying older events: https://slack-status.com/

Emails sent to teams using ServiceNow ticketing queues on Thursday, January 30, between 7:30 p.m. and 9:55 a.m. Friday, January 31 EST, were not generating tickets as expected. Ticket generation for newly received emails has been restored. Any emails sent during the outage window (that did not generate ServiceNow tickets) are being reprocessed to generate their respective ServiceNow tickets. IS&T is continuing to monitor the situation.

A fix has been implemented and IS&T is monitoring the service.

A fix was implemented and infrastructure services are restored. IS&T is monitoring services to confirm resolution.

Microsoft has applied a fix and is monitoring the situation.

Microsoft has applied a fix and shared the following update. Please take note of the action users need to take to resolve the trouble: "We've applied a configuration update and our testing indicates that this action has successfully mitigated impact. However, affected users will need to take action to apply the changes we've made and remediate the problem: - Outlook client and app users should restart their client or app to apply our changes. Outlook desktop client users may need to perform this action twice due to caching issues. - Outlook on the web users should refresh their sessions. If that does not mitigate the issue, users are encouraged to clear their browser cache and refresh their Outlook on the web session. We're working with impacted customers and are continuing to perform tests across the affected infrastructure to confirm that impact has been successfully addressed."

MIT's Webex service will be retired on August 30, 2024. No new MIT accounts will be created after June 7, 2024. For video conferencing, use MIT's Zoom service: https://mit.zoom.us