PubNub incident

Presence Latency

Minor Resolved View vendor source →

PubNub experienced a minor incident on August 22, 2024, lasting —. The incident has been resolved; the full update timeline is below.

Started
Aug 22, 2024, 10:32 PM UTC
Resolved
Aug 22, 2024, 10:32 PM UTC
Duration
Detected by Pingoru
Aug 22, 2024, 10:32 PM UTC

Update timeline

  1. resolved Aug 22, 2024, 11:32 PM UTC

    Beginning at 22:42 UTC some customers may have observed increased latency and errors for our Presence service in our Frankfurt and Mumbai regions. The issue has been resolved as of 22:50 UTC. We will continue to monitor the incident to ensure service stability has been fully restored.

  2. postmortem Sep 12, 2024, 08:08 PM UTC

    ### **Problem Description, Impact, and Resolution** At 22:42 UTC on August 22, 2024, we observed increased latency and errors for our Presence service. We found evidence of network issues from our own testing and monitoring, and we created a ticket with our network service provider for additional investigation. The issue was resolved as of 22:50 UTC. The root cause of this issue was a lack of monitoring and alerting around transient network issues within our network service provider's inter-VPC routing. ### **Mitigation Steps and Recommended Future Preventative Measures** To prevent a similar issue from occurring in the future we have configured the proper monitoring and alerting to provide us with enough time to address this issue before it can affect the QoS of our services.