Viirtue incident

Intermittent outage of ViiBE web portals (*.viibewithus.com)

Resolved after 1 hour 8 minutes, affecting ViiBE, on September 2, 2026.

resolved Sep 03, 2026, 12:57 AM UTC

A production Kubernetes node in the cloud provider failed and repeatedly dropped offline, which took the ingress gateway and several backend services with it. We added capacity, removed the failing node, and moved all workloads to healthy nodes.

Started
Sep 02, 2026, 11:48 PM UTC
Resolved
Sep 03, 2026, 12:57 AM UTC
Duration
1h 8m
Detected by Pingoru
Sep 02, 2026, 11:48 PM UTC

Affected components

ViiBE

Update timeline

  1. investigating Sep 02, 2026, 11:48 PM UTC

    Starting at approximately 22:46 UTC (6:46 PM ET) on September 2, ViiBE portals are intermittently unreachable. Users may see connection failures or a "no healthy upstream" error. The cause is a production Kubernetes node that is repeatedly going unhealthy, which is disrupting the ingress gateway that serves these sites. We have identified the failing node and are working to move traffic off it. Next update in 30 minutes.

  2. investigating Sep 02, 2026, 11:49 PM UTC

    We are continuing to investigate this issue.

  3. monitoring Sep 03, 2026, 12:15 AM UTC

    As of 5:12 PM PT, ViiBE services have restarted and the portals are loading again. A production Kubernetes node in the cloud provider failed and repeatedly dropped offline, which took the ingress gateway and several backend services with it. We added capacity, removed the failing node, and moved all workloads to healthy nodes. We are monitoring closely while services finish recovering.

  4. resolved Sep 03, 2026, 12:57 AM UTC

    A production Kubernetes node in the cloud provider failed and repeatedly dropped offline, which took the ingress gateway and several backend services with it. We added capacity, removed the failing node, and moved all workloads to healthy nodes.

Your product runs on more than Viirtue

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →