Ubidots incident

[EVENTS] Alerts targeting external services didn't work

Notice Resolved View vendor source →

Ubidots experienced a notice incident on April 10, 2024, lasting —. The incident has been resolved; the full update timeline is below.

Started
Apr 10, 2024, 02:09 PM UTC
Resolved
Apr 10, 2024, 11:00 AM UTC
Duration
Detected by Pingoru
Apr 10, 2024, 02:09 PM UTC

Update timeline

  1. resolved Apr 10, 2024, 02:09 PM UTC

    Between 10/04/2024 6:10 AM UTC-5 and 10/04/2024 6:50 AM UTC-5, the events module presented an issue sending alerts to external services. This impacted the event actions: Email, SMS, Voice call, Telegram, Slack notification, Functions and Webhooks. During this period, although the events triggered, the actions were not send as expected. The root cause came from a modification in our Kubernetes cluster that aims at simplifying the management of DNS records, and prevent errors in the future. Our DevOps team detected the problem in the configuration, fixed it and deployed again so the correct configuration would take effect.