PubNub incident

Increased errors and latency for presence in FRA and BOM

Minor Resolved View vendor source →

PubNub experienced a minor incident on June 2, 2025 affecting European Points of Presence and Presence Service and 1 more component, lasting —. The incident has been resolved; the full update timeline is below.

Started
Jun 02, 2025, 02:43 PM UTC
Resolved
Jun 02, 2025, 02:43 PM UTC
Duration
Detected by Pingoru
Jun 02, 2025, 02:43 PM UTC

Affected components

European Points of PresencePresence ServiceSouthern Asia Points of Presence

Update timeline

  1. resolved Jun 02, 2025, 02:43 PM UTC

    Starting at 12:20 UTC, we noticed an increase in errors and latency affecting the Presence service in the BOM and FRA regions. Our engineers investigated the issue and successfully restored the service completely, which has remained stable since 13:51 UTC.

  2. postmortem Jun 03, 2025, 05:10 PM UTC

    ### Problem Description, Impact, and Resolution Starting at 12:20 pm UTC on June 2, 2025, we noticed an increase in errors and latency affecting the Presence service in multiple regions. After investigating the increase in errors and latency, we identified the cause to be a higher-than-normal traffic pattern. In response, we scaled up resources to handle the request load, and the Presence service was fully restored in the affected regions by 1:51 PM UTC on June 2, 2025. ### Mitigation Steps and Recommended Future Preventative Measures To prevent a similar issue from occurring in the future, we are tuning our autoscaling configuration, as well as analyzing system behavior and bottlenecks observed during the incident window to inform further adjustments.