ODS Database failure

Update timeline

1. investigating Jul 31, 2019, 06:02 PM UTC

   The OD PROD database experienced an outage on Monday, July 29. The database service has been restored. However, some data is only current as of Monday afternoon. Changes from Banner are being synchronized to the database now. The estimated time for full recovery is not yet known. We will provide another update Thursday 8/1 in the morning or when service is fully restored - whichever comes first.

2. identified Aug 01, 2019, 03:05 PM UTC

   Due to the nature of the recovery, we will need to fully reload Banner data into the reporting database rather than apply updates of just the content that has changed since Monday. This process can take days.

3. identified Aug 01, 2019, 10:59 PM UTC

   We are continuing to work towards full restoration of the Operational Data Store (ODS) production database. Transactions from Banner that occurred after the crash need to be validated and this process will take some time. We do not anticipate that ODS will be fully restored before Monday, August 5. This outage affects services like: - Grant Reporting System (GRS) - Core Reporting - Jaspersoft - Reimbursement System - Scholarship System - Direct Payment System - OACIS We will send another update on Monday, August 5 or once ODS is fully restored; whichever comes first. If you have any questions or concerns regarding this outage, please contact the IS Service Desk: http://is.oregonstate.edu/help.

4. resolved Aug 05, 2019, 03:33 PM UTC

   Enterprise Computing Services has successfully restored the Operational Data Store (ODS) production database. The reload of Banner data into the ODS production database is complete, and CORE reports that rely on this data are now available. We apologize for the delay and will be taking steps to minimize the disruption caused by this type of event in the future.