Is Georgia Tech IT down?

OIT Network Engineering is aware of issues affecting the ability for new users to connect to the GT VPN service. Users may receive error messages such as "Authentication failed". Users with active sessions are not known to be impacted at this time. Engineers are actively investigating and working to resolve the issue.

Network Services restarted an authentication process on the firewall which hosts the GlobalProtect portal, which resolved the issue.

Network Services restarted an authentication process on the firewall which hosts the GlobalProtect portal, which resolved the issue.

The issue appears to either still be ongoing or reoccured, the network team is to continue to investigate.

Network Services has identified the root cause of the issue and is working to implement a resolution

Network Services restarted an authentication process on the firewall which hosts the GlobalProtect portal, which resolved the issue.

Users are Reporting Issues with Logging Into SSO, including "MFA Unavailable" messages. These errors appear to be related to an SSO issue between 9:10 and 9:30 PM ET, when SSO briefly switched to its backup environment. Teams are actively investigating. More updates will follow.

The sign-in issues that started on the evening of November 2, including "MFA Unavailable" errors, have been resolved. To restore stable service, our teams moved SSO from the on-premises environment to our cloud environment. Users can sign in normally again. Our teams will keep monitoring SSO to make sure it stays stable and will continue reviewing what caused the original issue. If you're still having trouble signing in, please contact the OIT Service Desk. Thank you for your patience while we worked to restore service.

Dear PACE users, To address a security vulnerability, all PACE clusters (Phoenix, ICE, and Firebird) will be taken offline today, Monday, November 2, at 2:00 PM. Read below for more information. For individuals who like to receive updates on PACE systems from https://status.gatech.edu/, the addition of new PACE categories requires current subscribers to resubscribe. To continue receiving notifications, visit the URL and click the "Subscribe" button in the top-right corner of the page. Summary: At 2:00 PM today, the Phoenix, ICE, and Firebird clusters will be taken offline so that a security patch can be applied. Work will continue overnight to apply patches. We will notify users as access to each cluster is restored. Details: PACE must apply a patch to fix a security vulnerability and keep our systems secure. To do this, every system has to be taken offline and re-imaged. The PACE team will work late into the evening and start early tomorrow morning to bring systems back online as quickly as possible. Impact: This outage will impact all PACE clusters (Phoenix, Firebird, ICE), during which users will not be able to log in to any PACE cluster. During this period, access to CEDAR storage will remain available. Access to other data storage locations (e.g., project directories) will be temporarily unavailable; restoring access through Globus is a priority and we will notify users once data access is available for the Phoenix and ICE clusters. Firebird storage will not be accessible during the outage. Jobs that have not started and will not finish prior to today at 2pm will be prevented from starting. Any jobs that have already started running and will be impacted by this downtime will be cancelled when the outage begins and will be refunded on December 1. We apologize for this unexpected downtime and appreciate your understanding while we work to keep our systems secure. Please contact us at [email protected] with any questions. You can read this email on our blog, and status updates will be shared on https://status.gatech.edu/ as the work progresses. Best, The PACE Team

Dear PACE users, Emergency maintenance on PACE systems will start at 2pm. For more information on services impacted, please read the original announcement on the PACE blog. Users will be notified as soon as individual clusters are fully restored. Additionally, information will be shared on the PACE blog and on https://status.gatech.edu/. Best, The PACE Team

Access to data on Phoenix and ICE using Globus is now available.

The status of each system has been updated.

Instructional cluster and Firebird compute nodes are passing health checks, with a few Phoenix nodes still pending. Additional storage, networking and user tests will begin shortly. Nexus cluster was patched and is back to normal operations.

The Phoenix and ICE clusters are now available. Users can log in and resume submitting jobs at any time. Work on the Firebird cluster is still ongoing.

The Firebird cluster is now available. Users can log in and resume submitting jobs. All PACE systems are operational, and the emergency maintenance is now complete.

The Network Team is investigating a power issue at Rich Interconnect. There is no detailed information at this time.

Power has been fully restored to the Rich Building, and all affected systems are back to normal operation. The IOC and Network teams are still investigating intermittent VPN issues. We'll send another update as soon as we have more information or the issue is resolved. Thank you for your patience.

Our support teams are still investigating several ongoing service issues. Affected services include, but may not be limited to: VPN access Network connectivity in some areas Campus Services Plesk-hosted websites BuzzPort BuzzCard transactions We'll send updates as we learn more and as services are restored. Thank you for your patience.

The service issues reported earlier today have been resolved, and the following services are working normally again: VPN access Network connectivity Campus Services Plesk-hosted websites BuzzPort BuzzCard transactions Our support teams will keep monitoring to make sure everything stays stable. If you're still having trouble with any of these services, please contact the OIT Service Desk. Thank you for your patience and understanding while we worked to restore service.

Monitoring of the service issues reported earlier today have been resolved, and the following services are working normally: VPN access Network connectivity Campus Services Plesk-hosted websites BuzzPort BuzzCard transactions Thank you for your patience and understanding while we worked to restore service.

Summary: The Slurm scheduler on ICE stopped functioning properly around midnight. Details: PACE is investigating the state of the scheduler and working to restore its function. Impact: Submitting, starting, or checking status on jobs would fail.

The ICE scheduler has been restarted and is again accepting jobs. PACE is monitoring the service and investigating the cause.

The ICE scheduler is functioning normally after being restarted.