Finale Inventory Outage History

We have identified an issue affecting our primary database. We have been working to identify the cause and are working to return the application to a working state.

We are starting a scheduled database maintenance period at 9pm Eastern which will last around 2 hours. The system will become unavailable for at least 15 minutes during this time.

We are aware of an authentication issue with the Descartes Global Authentication Portal that is preventing some customers from accessing the Finale Inventory application. These errors are intermittent, so, we suggest to keep trying to login until it succeeds. Our teams are actively working on a fix, and we apologize for the inconvenience.

We are investigating issues affecting report generation, integrations, and barcode scanner syncing. Some customers may experience delays or failed syncs. Our team is actively working to identify the cause and restore normal operation. For further inquiries, please contact [email protected]

Most errors appear to be related to an ongoing incident from AWS, see https://health.aws.amazon.com/health/status?path=open-issues We are throttling automatic integration tasks at least over the next hour to allow our system to recover. We will continue to monitor the incident at AWS and restart services as needed.

After restarting integrations, we are still seeing errors from many of our integration partners (specifically Amazon, ShipStation, and Shopify). Integration tasks can be triggered manually, but we are disabling automatic integration tasks again until Amazon has resolved the incident on their end.

We've identified one of our replica databases in an unhealthy state, which began causing application slowness. To prevent a broader impact, we have temporarily paused all integration tasks and are rebooting the affected database. Integrations will resume shortly, and we are actively monitoring the situation.

Currently testing a fix for the issue.

We are investigating an issue affecting the billing page. A fix is being worked on now - we hope to see billing back online within an hour.

We are aware of an issue saving entities (orders, products) that have whitespace in their ID. This was due to an upgrade to one of our libraries responsible for encoding URLs. We are rolling this change back now, and expect the issue to be fixed within the next half hour.

We were notified of an issue with a recently shipped code change affecting the shipment details screen. This is preventing users from accessing the shipment detail screen. We are reverting the failed code change now.

Scheduled maintenance on our database is taking longer than expected. We are going to stop and slowly restart all integration tasks to shed load from the system while the database recovers.

While shipping an upgrade to an internal system, we discovered a bug that caused new integration tasks (pull sales, push stock, sync products) to fail. Integration tasks are currently paused while we deploy a fix. We expect integration tasks will be started again in approximately thirty minutes, with all integration tasks coming online in one and a half hours.