Ziron incident

Intermittent APIv2 issues

Minor Resolved View vendor source →

Ziron experienced a minor incident on October 8, 2019 affecting API v1 and Ziron Dashboard, lasting 1h 9m. The incident has been resolved; the full update timeline is below.

Started
Oct 08, 2019, 04:53 PM UTC
Resolved
Oct 08, 2019, 06:03 PM UTC
Duration
1h 9m
Detected by Pingoru
Oct 08, 2019, 04:53 PM UTC

Affected components

API v1Ziron Dashboard

Update timeline

  1. investigating Oct 08, 2019, 04:53 PM UTC

    We are currently investigating some intermittent DNS resolution issues on our primary London K8S cluster on which APIv2 is based. This in turn may cause issues with porting request submission via the dashboard and APIv1.

  2. monitoring Oct 08, 2019, 05:20 PM UTC

    We've discovered an intermittent DNS resolution problem with one of the K8S worker nodes that was causing containers to misbehave. The offending node was drained and all affected containers have been moved to other nodes.

  3. resolved Oct 08, 2019, 06:03 PM UTC

    This incident has been resolved.