Is Georgia Tech IT down?

OIT is aware of a problem with the Georgia Tech Roles System (GRS) that is preventing rules and overrides from being created, deleted, and evaluated. Existing entitlements and dependent access are not affected, but changes are not being processed at this time. This means that anyone seeking new access or expecting to lose access to anything where access is controlled by GRS will see no changes in either direction until the issue is resolved. Related downstream effects include not being able to access GRS logs in IAT or use GRS related BuzzAPI endpoints. Feel free to massage as necessary. As an aside, the GRS database is huge. This may take some time.

OIT has implemented a fix believed to have resolved the issue affecting GRS. Administrators performed a restart of the database, and service has been restored. Support teams are currently monitoring the service to ensure changes continue to process normally

The majority of services are restored for most users, and we continue to observe broad service recovery. We recognize that some users may still experience residual impact, and addressing these remaining scenarios continues to be our highest priority. We’re actively progressing our mitigation efforts and closely monitoring service health as we work to ensure full recovery for all users.

We're performing additional remediation efforts where necessary to address any remaining impact from this incident. Reports from telemetry data and customer feedback are aligned, indicating a sustained recovery. We're actively monitoring the situation closely to ensure impact is completely mitigated. Next update by:

Support staff have received reports from multiple sources indicating that some students and employees are not being assigned to GRS roles as expected based on the delayed GRS rule processing. We are also observing inconsistent LDAP query performance that is further impacting rule processing. The team is actively investigating these issues, addressing individual cases and broader patterns, and evaluating potential query rerouting and service-side changes to improve performance and reliability. The next update will be provided within 2 hours.

Support staff investigated and identified a hardware bottleneck. They were able to resolve the issue causing the bottleneck and GRS performance is improving. Current estimates indicate it may take an additional 2-4 hours for the backlog to clear completely. The next update will be provided within 2 hours.

Support staff remains actively engaged in monitoring system performance as GRS processing and backlog continues to improve.

OIT continues to monitor GRS following the resolution of the hardware issue that caused processing delays. Approximately 93% of the backlog of pending role evaluations has been completed, and processing performance has continued to improve. However, some access assignments depend on other access assignments being completed first. This means that even though most records have been reviewed, some users may still be waiting for all of their access updates to be applied. Some students and employees may still experience delays while the remaining updates are processed.

GRS continues to recover following the hardware issue that caused delays in role processing. At this time, support staff expect the remaining backlog to be processed by the end of the day. Support staff will continue monitoring the service until processing has fully returned to normal.

GRS role processing went well over the weekend and it is believed the backlog has finally completed. Support is verifying with all stakeholders before giving the final all clear to resolve the issue

Beginning at 08:53 AM on August 24, users reported issues logging into GTIPAM DNS service. When attempting to login, users receive a 500 error. The service appears to be functioning normally with the exception of the login issue. Support staff are investigating and working to resolve the issue

Beginning at 8:10 AM on August 24, monitoring detected an outage affecting the Single Sign-On (SSO) service. As a result, users may have been unable to log in to applications that require SSO, including Banner Admin, Oscar, USG, Buzzport, Degree Audit, GTIPAM, andWorkday. Support staff have implemented a fix and are monitoring the situation

Support staff report they haven't seen any problems since 08:50 AM. They are continuing to monitor the situation.