CIT Geneseo Outage History

Started Oct 29, 2025, 01:14 PM UTC· resolved Oct 30, 2025, 12:28 PM UTC

1. investigating Oct 29, 2025, 01:14 PM UTC

   We are currently experiencing a print service disruption. Our CIT team is working to identify the root cause and implement a solution. All Pharos services are currently impacted.

2. monitoring Oct 29, 2025, 01:48 PM UTC

   Pharos Print Services are available again, and CIT is currently monitoring the situation.

3. resolved Oct 30, 2025, 12:28 PM UTC

   The issue impacting Pharos Print services has been resolved. Please ask CIT for assistance if you are still encountering any errors.

Read the full incident report →

Started Oct 20, 2025, 12:15 PM UTC· resolved Oct 21, 2025, 10:42 AM UTC

1. identified Oct 20, 2025, 12:15 PM UTC

   Amazon Web Services, which provide infrastructure for many services, are currently recovering from a global outage (https://health.aws.amazon.com/health/status) that affected a large number of applications and services. Most systems have started to recover, but Adobe and Atlassian Jira are still experiencing effects. https://status.adobe.com/ https://status.atlassian.com/ We will update as we receive new information.

2. identified Oct 20, 2025, 05:39 PM UTC

   As the AWS outage continues, we are discovering more affected systems. Brightspace - general slowness, assignment submission errors, document previews not loading, issues accessing course content Navigate - slowness, search errors CIT Self Help (Atlassian Confluence) - search errors, page loading errors

3. resolved Oct 21, 2025, 10:42 AM UTC

   Amazon has resolved their infrastructure issue, and our vendors have reported services have returned to normal. Please let us know if you notice any lingering problems as a result of the outage at https://help.geneseo.edu/cit

Read the full incident report →

Started Oct 15, 2025, 04:08 PM UTC· resolved Oct 15, 2025, 07:07 PM UTC

1. monitoring Oct 15, 2025, 04:08 PM UTC

   CIT was able to recreate reports from users that the Microsoft Teams integration for Google Calendar is not working. Affected users report expanding the Teams addon in the Google Calendar sidebar on the right and clicking Authorize or Sign In either returns an error or spins indefinitely. Neither Google nor Microsoft normally acknowledge these outages; we will update again when we notice the Teams addon for Google Calendar is working again.

2. resolved Oct 15, 2025, 07:07 PM UTC

   CIT folks have been able to refresh Google Calendar and load the Teams addon sidebar, as well as add Teams meeting information to Google Calendar events. It appears the outage has been resolved.

Read the full incident report →

Started Oct 12, 2025, 03:02 PM UTC· resolved Oct 12, 2025, 07:17 PM UTC

1. investigating Oct 12, 2025, 03:02 PM UTC

   We have received reports that emails to Jira Service Desks are not being processed. We are investigating the issue now.

2. identified Oct 12, 2025, 05:20 PM UTC

   We have discovered the cause of the issue is an inability for Jira to retrieve OAUTH tokens from Google. Jira support suggested deleting and re-adding the email addresses used for email correspondence with our service desks. This resolved the issue temporarily, but the same problem has come back within an hour or two. We have opened support requests with Atlassian and Google to investigate further.

3. resolved Oct 12, 2025, 07:17 PM UTC

   Atlassian has identified an internal issue and applied a fix to mitigate it, so email processing issues are now resolved. Since the issue was with authentication, emails not processed during the outage should now be caught up. https://developer.status.atlassian.com/incidents/7dp5zv6byqgd

Read the full incident report →

Started Oct 11, 2025, 11:30 AM UTC· resolved Oct 11, 2025, 05:41 PM UTC

1. investigating Oct 11, 2025, 11:30 AM UTC

   We have received reports that many servers on campus are not responding. We are investigating the issue now.

2. monitoring Oct 11, 2025, 12:23 PM UTC

   We have identified and resolved the storage issue that caused the outage on campus. Services have been restored and we are monitoring affected systems.

3. resolved Oct 11, 2025, 05:41 PM UTC

   This incident has been resolved.

Read the full incident report →

Started Sep 04, 2025, 12:49 PM UTC· resolved Sep 05, 2025, 04:19 PM UTC

1. investigating Sep 04, 2025, 12:49 PM UTC

   Our automated telephone operator is currently down. We are working with the vendor to resolve the issue. We will have an update by 11:00am.

2. investigating Sep 04, 2025, 03:30 PM UTC

   We are working with our vendor on replacing the automated telephone operator. The system is still down. We will have another update by 2:00pm.

3. investigating Sep 04, 2025, 06:28 PM UTC

   We have identified a solution to the issue and we are working with our vendor to begin implementing it. We will have another update by 4:00pm.

4. investigating Sep 04, 2025, 08:08 PM UTC

   We are still preparing to implement the solution with our vendor.

5. resolved Sep 05, 2025, 04:19 PM UTC

   The automated telephone operator is operational and the issues have been fully resolved.

Read the full incident report →

Started Aug 23, 2025, 04:49 PM UTC· resolved Aug 24, 2025, 03:05 PM UTC

1. investigating Aug 23, 2025, 04:49 PM UTC

   We’re currently experiencing an issue receiving external calls to the CIT HelpDesk phone line. Our team is actively working to resolve the issue. In the meantime, please submit all support requests through the CIT Service Desk at https://geneseo.atlassian.net/servicedesk/customer/portal/12. We apologize for the inconvenience and appreciate your patience!

2. resolved Aug 24, 2025, 03:05 PM UTC

   We have resolved the issues with incoming helpdesk calls.

Read the full incident report →

Started Aug 12, 2025, 02:59 PM UTC· resolved Aug 12, 2025, 05:36 PM UTC

1. monitoring Aug 12, 2025, 02:59 PM UTC

   Some users are unable to add Microsoft Teams conferencing meetings to Google Calendar events. Neither Google or Microsoft have acknowledged the outage and there is currently no ETA on a resolution. If a team's meeting is needed immediately, meetings can still be initiated directly from Microsoft Teams. We will continue monitoring the issue and will provide an update once we have more information.

2. resolved Aug 12, 2025, 05:36 PM UTC

   After testing and receiving multiple successful results issue with the Google Calendar and Microsoft Teams integration has been resolved. If you are still experiencing issues please contact the help desk for further assistance.

Read the full incident report →

Started Aug 04, 2025, 02:53 PM UTC· resolved Aug 04, 2025, 03:45 PM UTC

1. investigating Aug 04, 2025, 02:53 PM UTC

   Docuware is unavailable. We are investigating.

2. resolved Aug 04, 2025, 03:45 PM UTC

   This incident has been resolved.

Read the full incident report →

Started Jul 29, 2025, 03:37 PM UTC· resolved Jul 29, 2025, 06:06 PM UTC

1. investigating Jul 29, 2025, 03:37 PM UTC

   Some new accounts are not properly syncing from our on premises Active Directory to Microsoft's cloud Entra ID directory. These accounts to do not successfully finish the claim process and are unable to log in to any SSO services. We are investigating the problem now.

2. resolved Jul 29, 2025, 06:06 PM UTC

   There was an issue with directory replication that has now been resolved. Syncing is again working properly and new accounts can be claimed properly. If you encounter any further problems, please Ask CIT! Call 585-245-5588, email [email protected], or submit a request to https://geneseo.atlassian.net/servicedesk/customer/portal/12/group/28/create/153 and we'll be happy to assist you.

Read the full incident report →

Started Jul 29, 2025, 01:20 PM UTC· resolved Jul 29, 2025, 07:42 PM UTC

1. investigating Jul 29, 2025, 01:20 PM UTC

   Docuware is currently unavailable. We are investigating.

2. resolved Jul 29, 2025, 07:42 PM UTC

   This incident has been resolved.

Read the full incident report →

Started Jul 16, 2025, 06:08 PM UTC· resolved Jul 16, 2025, 07:10 PM UTC

1. investigating Jul 16, 2025, 06:08 PM UTC

   We have received several reports that users are seeing a popup that Google Drive access has been restricted to authorized devices and has logged them out of their account. As far as we are aware, web access to Google Drive is unaffected. We are investigating the problem now.

2. resolved Jul 16, 2025, 07:10 PM UTC

   People experiencing this problem been reporting that, after rebooting, their Google Drive client app is working again. If you reboot your computer and are still unable to sign in to the Windows/macOS Google Drive desktop app, please reach out to the CIT HelpDesk via one of the methods at https://www.geneseo.edu/cit.

Read the full incident report →

Started Jun 09, 2025, 06:26 PM UTC· resolved Jun 09, 2025, 07:12 PM UTC

1. identified Jun 09, 2025, 06:26 PM UTC

   The storm is bringing power outages across campus. Network services are down in Erie, Niagara, Steuben and the Stadium right now. We will watch the storm and see what we can do to get services restored.

2. identified Jun 09, 2025, 06:48 PM UTC

   The power outages continue across campus. Now Ontario is down.

3. resolved Jun 09, 2025, 07:12 PM UTC

   Power is back everywhere on campus. Services are restored.

Read the full incident report →

Started Jun 09, 2025, 03:13 PM UTC· resolved Jun 10, 2025, 06:19 PM UTC

1. investigating Jun 09, 2025, 03:13 PM UTC

   We have received several reports that the Pharos Secure Print queue has been removed from Windows computers on campus. We are investigating the issue now. If you are experiencing this issue and still need to print, please try using web print at https://go.geneseo.edu/printing

2. investigating Jun 09, 2025, 06:19 PM UTC

   We have engaged Pharos support and are working on identifying the issue with log files we collected from some affected Windows computers. We will provide another update by 4pm. Web print at https://go.geneseo.edu/printing should continue to work for anyone experiencing this issue.

3. identified Jun 09, 2025, 08:03 PM UTC

   We have identified an issue with Pharos looking up users on domain-bound Windows computers. We have deployed a fix on some computers, but it has not worked in every case. We are continuing to test, and will update again tomorrow morning.

4. resolved Jun 10, 2025, 06:19 PM UTC

   A fix has been implemented for the Pharos print queue issue related to this outage. If you are experiencing issues with documents not showing up in your Pharos print queue you will need to run a file on your device to correct the problem. After running the file and restarting your device, you should be able to print again. CIT will be reaching out to those with existing tickets with this solution. If you have not submitted a ticket for this issue please do so, or if you still need assistance, Ask CIT. Call the HelpDesk at (585) 245-5588 or submit a request at https://geneseo.atlassian.net/servicedesk/customer/portal/12/group/28/create/153.

Read the full incident report →

Started Jun 09, 2025, 12:03 AM UTC· resolved Jun 09, 2025, 09:39 AM UTC

1. investigating Jun 09, 2025, 12:03 AM UTC

   Some KnightWeb pages are unavailable after our upgrades this afternoon. SUNY ITEC is investigating.

2. resolved Jun 09, 2025, 09:39 AM UTC

   This incident has been resolved.

Read the full incident report →

Started May 23, 2025, 11:01 AM UTC· resolved May 23, 2025, 06:39 PM UTC

1. investigating May 23, 2025, 11:01 AM UTC

   We are currently investigating network outages scattered across campus. The equipment outages are likely a result of a brief power outage in Geneseo last night. We will update the status with more information as it is discovered.

2. resolved May 23, 2025, 06:39 PM UTC

   This incident has been resolved.

Read the full incident report →

Started May 01, 2025, 07:14 PM UTC· resolved May 01, 2025, 07:33 PM UTC

1. identified May 01, 2025, 07:14 PM UTC

   The Xtender Server is having issues this afternoon, we are planning to reboot the server at 3:30 PM

2. resolved May 01, 2025, 07:33 PM UTC

   The server has been restarted, and is operating normally.

Read the full incident report →

Started Apr 29, 2025, 11:37 AM UTC· resolved Apr 29, 2025, 12:29 PM UTC

1. investigating Apr 29, 2025, 11:37 AM UTC

   We are investigating a network outage in Lauderdale. All network-based services are down, including phone, print, wifi, internet, fax, There is no access to cloud-hosted services. We plan share an update by 8:15 am.

2. monitoring Apr 29, 2025, 12:11 PM UTC

   We have restarted the network electronics in the Lauderdale network closet and services are coming back now. We are continuing to monitor.

3. resolved Apr 29, 2025, 12:29 PM UTC

   All network services in Lauderdale are restored.

Read the full incident report →

Started Apr 21, 2025, 03:12 PM UTC· resolved Apr 21, 2025, 05:51 PM UTC

1. investigating Apr 21, 2025, 03:12 PM UTC

   We are currently investigating this issue.

2. monitoring Apr 21, 2025, 03:29 PM UTC

   The Xtender server has been restarted, and we are monitoring the operation

3. resolved Apr 21, 2025, 05:51 PM UTC

   No additional issues have been reported.

Read the full incident report →

Started Apr 08, 2025, 01:15 PM UTC· resolved Apr 10, 2025, 06:32 PM UTC

1. investigating Apr 08, 2025, 01:15 PM UTC

   The AIMS parking system has run out of space in its database and is experiencing issues as a result, this includes the aims.geneseo.edu parking site where permits can be ordered. We will be doing an upgrade on the database to attempt to mitigate this issue starting at 10 am. During this time, both the AIMS app and the aims.geneseo.edu site will be unavailable.

2. monitoring Apr 08, 2025, 03:30 PM UTC

   We have successfully ugpraded the database software for AIMS and functionality appears to have returned to normal. Please report any issues with the AIMS site to the Parking & Transportation office ([email protected]).

3. resolved Apr 10, 2025, 06:32 PM UTC

   This incident has been resolved.

Read the full incident report →

Started Mar 31, 2025, 11:20 AM UTC· resolved Mar 31, 2025, 11:51 AM UTC

1. investigating Mar 31, 2025, 11:20 AM UTC

   We are investigating a network outage in Blake A. All internet, print, voice, data, and wifi services are down in the Blake A CAS area.

2. identified Mar 31, 2025, 11:41 AM UTC

   We have determined that we have a failed strand of fiber-optic cable between South Hall and Blake Hall. We are about to begin switching to different cable now. We hope to have service restored as close to 8am as possible.

3. resolved Mar 31, 2025, 11:51 AM UTC

   We have successfully moved Blake A off the damaged fiber, all services are returning now.

Read the full incident report →

Started Mar 14, 2025, 07:39 PM UTC· resolved Mar 21, 2025, 05:32 PM UTC

1. investigating Mar 14, 2025, 07:39 PM UTC

   SUNY Online has both become aware and reproduced an error that occurs when attempting to publish grades and sorting by name in the Grades tool within Brightspace after the March 2025 Release. This issue is not unique to SUNY as other D2L clients are experiencing this issue after this update was applied to all D2L production environments. As a result, SUNY Online opened a priority 1 ticket with D2L support and ensured that it has been escalated internally via our Technical Account Managers. We will reach out again with any additional information, including any possible workarounds, as we receive it.

2. identified Mar 15, 2025, 05:33 PM UTC

   D2L deployed a hotfix to address the error users were encountering when publishing grades. SUNY has tested and confirmed that users no longer receive an error message when publishing grades. Please note, this hotfix does not address the issue with sorting by name in the Grades tool. Although both issues are related to the Grades tool, the sorting issue will be addressed in a separate patch that is currently being developed by D2L.

3. resolved Mar 21, 2025, 05:32 PM UTC

   We were notified that a hotfix was put into place around 1:15am this morning to resolve the sorting by last name issue in the gradebook. The issue appears to be fixed and the sorting functionality in the grades tool now works for both first name and last name (A-Z and Z-A). If you experience any future issues, please email [email protected]

Read the full incident report →

Started Mar 13, 2025, 06:59 PM UTC· resolved Mar 13, 2025, 07:19 PM UTC

1. identified Mar 13, 2025, 06:59 PM UTC

   One of the internet service providers that we use has notified us they are having an outage. Their outage is causing us to experience issues connecting to some internet services because our connection through them is coming and going, instead of just being down. (If it were down, all our connections would reroute and be successful.) We will update when we know more.

2. monitoring Mar 13, 2025, 07:11 PM UTC

   Our connection seems to have stabilized and traffic flows are looking normal.

3. resolved Mar 13, 2025, 07:19 PM UTC

   Our ISP has reported the issue resolved, and several of our users report successful connections.

Read the full incident report →

Started Mar 10, 2025, 02:56 PM UTC· resolved Mar 10, 2025, 05:52 PM UTC

1. investigating Mar 10, 2025, 02:56 PM UTC

   Mar 10, 2025 10:49 AM (UTC-4) Impact severity: Major Impact scope: Some customers are impacted. Services impacted: Send for Signature(Send for Signature) Environments impacted: Adobe Acrobat Sign North America 1, Adobe Acrobat Sign Europe 1 Impact update: We’ve changed the severity level from minor to major for the availability issue. Previous updates: Mar 10, 2025 10:39 AM (UTC-4) We’re investigating a performance issue.

2. resolved Mar 10, 2025, 05:52 PM UTC

   Adobe has resolved the issue.

Read the full incident report →