Fini AI experienced a minor incident on November 14, 2024, lasting —. The incident has been resolved; the full update timeline is below.
Update timeline
- resolved Nov 14, 2024, 10:27 AM UTC
On 12th Nov 2024, we experienced a temporary 5-minute downtime in our chat queue management service due to scheduled maintenance on our Redis instance by our cloud provider. This led to brief service interruptions in chat-related operations.
- postmortem Nov 14, 2024, 10:27 AM UTC
**Incident Summary** On 12th Nov 2024, we experienced a temporary 5-minute downtime in our chat queue management service due to scheduled maintenance on our Redis instance by our cloud provider. This led to brief service interruptions in chat-related operations. **Impact** During this maintenance window, our chat queues experienced a 5-7 minute delay in processing, resulting in potential delays in customer interactions and response times. We apologize for any inconvenience this may have caused. **Root Cause** The temporary interruption stemmed from our current maintenance configuration with our Redis provider. This configuration includes a brief maintenance window scheduled by the cloud provider approximately every two weeks. **Resolution** To address this, we have scheduled our maintenance window to Sundays at 6 PM Central Time to minimize customer impact during this period. This interim measure will ensure that any potential interruptions occur at a low-traffic time, reducing the likelihood of customer disruption. **Next Steps** We are actively implementing a more robust setup that avoids this scheduled downtime altogether. The upgraded solution will be operational within the next two weeks, ensuring a consistent and uninterrupted chat experience moving forward. **Customer Impact Mitigation** * **Scheduled Maintenance Timing:** Maintenance will occur on Sundays at 6 PM CT to minimize disruption. * **Planned Upgrade:** Implementation of the enhanced setup is already underway, with full deployment expected within two weeks. We appreciate your understanding and patience as we work to enhance our infrastructure to provide you with the best possible service.