JustCall experienced a major incident on February 10, 2021 affecting Filestack, lasting 1h 24m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 10, 2021, 09:05 PM UTC
We rely on Filestack to facilitate file upload and that seems to be down right now. You can check their status here https://status.filestack.com/
- identified Feb 10, 2021, 09:06 PM UTC
The issue has been identified, we are contacting Filestack for more details. We will wait for them to fix the issue they have been facing.
- identified Feb 10, 2021, 09:09 PM UTC
Here's what the Filestack team has confirmed: AWS confirmed the issue with their load balancers (https://status.aws.amazon.com/) that we are monitoring closely. In the meantime, we have provisioned emergency load balancers cluster and directed CDN traffic through it. Delivery and transformations should be back to normal, however uploads are still affected.
- monitoring Feb 10, 2021, 09:57 PM UTC
Here's what the Filestack team has confirmed: US-EAST-1 uploads traffic was rerouted through our API servers in other regions. AWS confirmed that they have implemented fix and are deploying it to affected load balancers.
- monitoring Feb 10, 2021, 10:20 PM UTC
Things are looking good from their end. We hope that this will be resolved soon. Meanwhile, the upload service is back and the FileStack status page shows they have implemented the fix.
- resolved Feb 10, 2021, 10:31 PM UTC
Our engineering team has confirmed that uploads are back. Though Filestack hasn't confirmed just yet (they had a super bad day of course), but we are confirming that the issue has been resolved. We apologize for the inconvenience caused and looks like it was something to do with cloud giant AWS.