Ambra experienced a notice incident on February 5, 2025 affecting Web Services and Image Processing and 1 more component, lasting 41m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 05, 2025, 12:36 AM UTC
We have identified an issue affecting InteleShare. Our Engineering teams have been mobilized to address the issue, and we will provide frequent updates to keep you informed.
- monitoring Feb 05, 2025, 12:42 AM UTC
A fix has been implemented and the platform is available now. We are monitoring closely.
- resolved Feb 05, 2025, 01:17 AM UTC
The incident has been fully resolved and service is back to normal levels. Our team will be conducting a root cause analysis and sharing. We will continue to monitor the situation to ensure there are no further issues.
- postmortem Feb 11, 2025, 05:11 PM UTC
While implementing a minor change to the InteleShare database schema, a database update process was able to acquire some locks it needed to implement the schema change but hung while waiting to acquire the remaining locks. Since it had already acquired some locks, the update process blocked certain normal database activity, causing UI and API errors. We were able to identify and cancel a long-running background process which had not properly released its locks and which was preventing the database update. Our R&D and operations teams will investigate future improvements to our update processes, by implementing or adjusting timeouts to ensure schema updates can fail and retry as needed without affecting normal system activity.