Currents experienced a minor incident on August 14, 2023, lasting —. The incident has been resolved; the full update timeline is below.
Update timeline
- resolved Aug 14, 2023, 11:22 PM UTC
Type: Incident Duration: 23 hours and 53 minutes Affected Components: API - HTTP REST API, API - Dashboard Browsing, Data Ingestion Aug 15, 17:39:35 GMT+0 - Monitoring - Scaling up Redis cluster completed. We are currently monitoring the system performance. Aug 14, 23:22:42 GMT+0 - Investigating - We are experiencing intermittent parallelization-related issues. Arbitrary can fail to report their results. https://currents.instatus.com Aug 14, 23:36:33 GMT+0 - Identified - The root cause has been identified - the backed Redis cluster exceeded the allowed network bandwidth limits, causing some requests to drop. Performing cluster reconfiguration. Aug 15, 00:14:13 GMT+0 - Monitoring - Reconfiguring the Redis configuration was completed and the # of errors dropped to 0. Working on follow-up tasks to ensure better scalability. Monitoring the errors. Aug 15, 06:36:09 GMT+0 - Resolved - This incident has been resolved. Aug 15, 16:38:51 GMT+0 - Identified - Reverting the status back to "Identified." Scaling up the cluster to accommodate the increased demand. The backed Redis cluster exceeded the allowed network bandwidth limits, causing some requests to drop. Aug 15, 23:15:27 GMT+0 - Resolved - This incident has been resolved.