Molecule experienced a notice incident on March 5, 2024 affecting Molecule, lasting 2h 19m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Mar 05, 2024, 03:45 PM UTC
We are experiencing some delays in processing copied curves for 3/5/2024. Our Engineering team is aware and are working on the issue. We will update once we have a resolution. This does not affect 3/4/2024 valuations.
- identified Mar 05, 2024, 05:13 PM UTC
The issue has been identified and fix has been implemented. Market data and Valuation jobs are queued up and processing.
- resolved Mar 05, 2024, 06:05 PM UTC
This incident has been resolved.
- postmortem Mar 06, 2024, 05:54 PM UTC
**Summary** On the morning of March 5, 2024, there were some delays related to prior day market data being copied to the current day. The incident was first noticed at approximately 8:00 AM CST and was fully resolved by 12:00 PM CST. We apologize for the interruption, and would like to share a summary of the incident. **What Happened** You may have noticed that some or all market data from the previous day did not get copied to the current day, resulting in incorrect current day valuations. **Why?** A bug was discovered that created duplicates of certain market prices. The result of these duplicates was the inability to successfully copy the prior day's market prices due to database constraints. **Preventing This Type of Issue** The bug that caused this issue has been fixed. Thank you for your patience, and once again––we’re sorry for the interruption.