Flow Collector Incident affecting FA+, CMC & CSC 10/13/18

Update timeline

1. resolved Oct 19, 2018, 12:03 AM UTC

   A Flow Analyze+ (FA+) netflow ingest issue occurred on Saturday, October 13th at 16:24:23 UTC that impacted a subset of customers who directed their netflow to a specific redundant pair of netflow receivers. Full operation was recovered on Monday, October 15th at 18:53:18. We have taken measures to remediate and all FA+ systems are functioning at this time. Incident Details • One of the Flow collectors and additionally its standby environment stopped processing flow data starting 10/13/18 at 16:24:23 UTC time. • The service was restored at 10/15/18 at 18:53:18 UTC time. Root Cause Analysis (RCA): • We have already fixed both production and standby environments. • Root cause is not known yet. We are continuing to investigate and will communicate our findings as we learn them. Remediation Actions: • Enhance monitoring systems to add an early detection feature for these types of anomalies. • Improve high availability infrastructure. • Continue to investigate incident to determine root cause. Please accept our apologies and know that we are proactively putting measures into place to prevent this type of incident from happening in the future. We understand that you may have additional questions, do not hesitate to reach out to your Customer Success Manager.