Blues experienced a major incident on January 18, 2024 affecting Cellular Notecards, lasting 3h 33m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- resolved Jan 18, 2024, 11:23 PM UTC
Some Blues cellular Notecards were unable to connect to Notehub between Jan 17 at 2:40pm EST and Jan 18 at 6:13pm. This was caused by an unanticipated issue with our networking provider. From our initial analysis, it appears that many but not all of the impacted Notecards were outside the US. We have implemented a workaround that fixes this issue. We have updated our networking procedures to insure that it does not recur. Finally, we will be working with our network provider to better understand why it occurred in the first place. Since Notecards cache all event data, events generated during the period were sent after the issue was resolved.