Radar experienced a notice incident on October 6, 2021 affecting Track API and Dashboard and 1 more component, lasting 6h 1m. The incident has been resolved; the full update timeline is below.
Affected components
Track APIDashboardWebhooksSearch APIsData ImportGeocoding APIsData ExportRouting APIs
Update timeline
- investigating Oct 06, 2021, 01:27 AM UTC
We are investigating elevated API errors and latencies.
- investigating Oct 06, 2021, 01:51 AM UTC
We are continuing to investigate this issue.
- investigating Oct 06, 2021, 01:53 AM UTC
We are continuing to investigate this issue.
- investigating Oct 06, 2021, 02:28 AM UTC
We are continuing to investigate this issue.
- identified Oct 06, 2021, 03:28 AM UTC
We have identified the issue and are implementing a fix.
- resolved Oct 06, 2021, 06:34 AM UTC
This incident has been resolved. Due to a code rollback, an index build was triggered, leading to CPU and IO pressure on our database. This index has completed building and all services have returned to normal latencies.