Finale Inventory had 14 outages in the last 2 years totaling 1327h 19m of downtime — averaging 0.6 incidents per month.
There were 14 Finale Inventory outages since May 26, 2024 totaling 1327h 19m of downtime. Each is summarised below — incident details, duration, and resolution information.
We are starting a scheduled database maintenance period at 9pm Eastern which will last around 2 hours. The system will become unavailable for at least 15 minutes during this time.
The migration has completed. Integrations are coming online slowly over the next hour.
We are aware of an authentication issue with the Descartes Global Authentication Portal that is preventing some customers from accessing the Finale Inventory application. These errors are intermittent, so, we suggest to keep trying to login until it succeeds. Our teams are actively working on a fix, and we apologize for the inconvenience.
Login is resolved for all customers, in case of questions, please submit a ticket to our support team.
We are investigating issues affecting report generation, integrations, and barcode scanner syncing. Some customers may experience delays or failed syncs. Our team is actively working to identify the cause and restore normal operation. For further inquiries, please contact [email protected]
Most errors appear to be related to an ongoing incident from AWS, see https://health.aws.amazon.com/health/status?path=open-issues We are throttling automatic integration tasks at least over the next hour to allow our system to recover. We will continue to monitor the incident at AWS and restart services as needed.
Amazon has provided an update that most services are recovering, see https://health.aws.amazon.com/health/status?path=service-history: "Oct 20 9:13 AM PDT We have taken additional mitigation steps to aid the recovery of the underlying internal subsystem responsible for monitoring the health of our network load balancers and are now seeing connectivity and API recovery for AWS services. We have also identified and are applying next steps to mitigate throttling of new EC2 instance launches. We will provide an update by 10:00 AM PDT." We have restarted automatic integration tasks and will continue to monitor them as the system comes back online.
After restarting integrations, we are still seeing errors from many of our integration partners (specifically Amazon, ShipStation, and Shopify). Integration tasks can be triggered manually, but we are disabling automatic integration tasks again until Amazon has resolved the incident on their end.
We have re-enabled integrations and are not seeing errors. We will continue to monitor the system as it comes back online to full capacity.
We have observed several delays in our job processing code, used for UI imports and our Android scanner. We are still investigating, but are restarting customer accounts to mitigate this issue. Also, we are still seeing increased latency for several integration partners as well as our cloud provider, AWS. To mitigate the impact of this on our system, we have restarted integration tasks again which will throttle integration task runs over the next hour.
All systems appear to have returned to normal operation. Please reach out to support ([email protected]) if you continue to experience disruptions with your account.
We've identified one of our replica databases in an unhealthy state, which began causing application slowness. To prevent a broader impact, we have temporarily paused all integration tasks and are rebooting the affected database. Integrations will resume shortly, and we are actively monitoring the situation.
We have resumed the integration tasks and continue monitoring the system.
This incident has been resolved.
We are currently investigating the issue. Starting Monday September 30th at 11:41 AM PT, push stock tasks started failing to update listings. This was caused by a change on Etsy's side. Etsy's API started telling us that the reason our update requests are failing is that "All offerings need readiness state".
Currently testing a fix for the issue.
This incident has been resolved. It may take up to 24 hours to fully return to normal due to Etsy having Daily API rate limits.
We are investigating an issue affecting the billing page. A fix is being worked on now - we hope to see billing back online within an hour.
This incident has been resolved.
We are aware of an issue saving entities (orders, products) that have whitespace in their ID. This was due to an upgrade to one of our libraries responsible for encoding URLs. We are rolling this change back now, and expect the issue to be fixed within the next half hour.
We have shipped out a fix and are monitoring the results. Please refresh your screen. If you are continuing to have issues, please reach out to customer support.
This incident has been resolved.
We were notified of an issue with a recently shipped code change affecting the shipment details screen. This is preventing users from accessing the shipment detail screen. We are reverting the failed code change now.
We have reverted the offending code. If you are still seeing issues, please refresh your screen. We will be deploying a permanent fix within the next 15 minutes.
This incident has been resolved.
Scheduled maintenance on our database is taking longer than expected. We are going to stop and slowly restart all integration tasks to shed load from the system while the database recovers.
Maintenance is now complete. We are monitoring the system as it comes back online.
All systems appear to have returned to normal. Integrations will continue to slowly restart over the next hour 50 minutes. During this time, some customers may see their automated integration tasks not running. Manual integration tasks are not affected.
This incident has been resolved.
We are currently experiencing an issue with our QuickBooks Online integration. The issue appears to be on QuickBooks Online's side. It is causing our integrations to suddenly get "name in use" errors.
This incident has been resolved.
We’re experiencing technical difficulties. Our team is working on it and will provide updates shortly For further inquiries, please contact [email protected]
We have identified failing backend services and have applied solutions, the access to accounts is restored. We keep monitoring and working on improving the state of the system. For further inquiries, please contact [email protected]
We have pushed fixes and restarted unhealthy servers, the access to accounts is fully restored, performance is good and our monitoring shows no more erros. For further inquiries, please contact [email protected]
While shipping an upgrade to an internal system, we discovered a bug that caused new integration tasks (pull sales, push stock, sync products) to fail. Integration tasks are currently paused while we deploy a fix. We expect integration tasks will be started again in approximately thirty minutes, with all integration tasks coming online in one and a half hours.
A fix has been implemented and we are monitoring the results.
Automated integration tasks have been restarted. Automated tasks should be fully online after 7:47pm Pacific.
Our email provider is experiencing an outage, and as a result email sending capabilities in Finale Inventory are not working. We're monitoring the status of our email provider and will provide updates accordingly
We are continuing to monitor for any further issues.
This incident has been resolved.
Scheduled maintenance is nearly complete. We are continuing to monitor progress, and expect maintenance to be complete in ~30 minutes.
Scheduled maintenance is nearly complete. We are continuing to monitor progress, and expect maintenance to be complete in ~30 minutes.
All systems are back online. Automated integration tasks are gradually restarting, and will be back online in 1 hour.
This scheduled maintenance has completed.