Panoply incident

Job system scheduling issue

Major Resolved View vendor source →

Panoply experienced a major incident on February 26, 2019 affecting Data Sources, lasting 3h 12m. The incident has been resolved; the full update timeline is below.

Started
Feb 26, 2019, 02:45 PM UTC
Resolved
Feb 26, 2019, 05:58 PM UTC
Duration
3h 12m
Detected by Pingoru
Feb 26, 2019, 02:45 PM UTC

Affected components

Data Sources

Update timeline

  1. identified Feb 26, 2019, 02:45 PM UTC

    We have identified an issue with the job scheduler affecting customer jobs. Because of this we have temporarily disabled the scheduling of new jobs until the issue is resolved. We are working hard to resolve the matter as quickly as possible. Your data is safe and no action is required by the users. Job queue will be ingested once the incident is resolved.

  2. monitoring Feb 26, 2019, 04:03 PM UTC

    The issue was resolved and we are now monitoring our data sources job queue.

  3. resolved Feb 26, 2019, 05:58 PM UTC

    This incident has been resolved.