POS Portal incident

API Outage

Resolved after 39 minutes, on February 16, 2019.

postmortem Feb 19, 2019, 12:13 PM UTC

_Over the weekend, POS Portal experienced a server disk space constraint causing the Production API servers to be unresponsive to all API calls. This caused degraded performance on all systems connected with the POS Portal API servers. The duration of the outage was caused by a gap in the system monitoring. Once the issue was identified, it was resolved within 12 minutes._ _The gap in the monitoring as been resolved and all other monitoring is being reviewed and updated as needed. The Development team will be engaged to determine how to prevent future constraints._ ‌ Incident Timeline: Start: 2/16/19 7:18 AM PST Resolved: 2/18/19 at 7:55 AM PST

Started
Feb 16, 2019, 03:15 PM UTC
Resolved
Feb 16, 2019, 03:55 PM UTC
Duration
39m
Detected by Pingoru
Feb 16, 2019, 03:15 PM UTC

Update timeline

  1. resolved Feb 19, 2019, 12:13 PM UTC

    The POS Portal API is unavailable

  2. postmortem Feb 19, 2019, 12:13 PM UTC

    _Over the weekend, POS Portal experienced a server disk space constraint causing the Production API servers to be unresponsive to all API calls. This caused degraded performance on all systems connected with the POS Portal API servers. The duration of the outage was caused by a gap in the system monitoring. Once the issue was identified, it was resolved within 12 minutes._ _The gap in the monitoring as been resolved and all other monitoring is being reviewed and updated as needed. The Development team will be engaged to determine how to prevent future constraints._ ‌ Incident Timeline: Start: 2/16/19 7:18 AM PST Resolved: 2/18/19 at 7:55 AM PST

Your product runs on more than POS Portal

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →