Geoscape Australia incident

PSMA Cloud (GNAF Live) and Predictive AV - WA address issue

Minor Resolved View vendor source →

Geoscape Australia experienced a minor incident on March 6, 2019 affecting Predictive API, lasting 4h 5m. The incident has been resolved; the full update timeline is below.

Started
Mar 06, 2019, 12:14 AM UTC
Resolved
Mar 06, 2019, 04:19 AM UTC
Duration
4h 5m
Detected by Pingoru
Mar 06, 2019, 12:14 AM UTC

Affected components

Predictive API

Update timeline

  1. investigating Mar 06, 2019, 12:14 AM UTC

    It appears that there is only a partial load of WA addresses for the GNAF Live and Predictive AV services.

  2. investigating Mar 06, 2019, 01:02 AM UTC

    This issue now only affects the PSMA Cloud GNAF Live service. The Predictive AV service is returning all addresses for WA.

  3. resolved Mar 06, 2019, 04:19 AM UTC

    GNAF Live functions in PSMA Cloud are now returning all addresses for WA.

  4. postmortem Mar 07, 2019, 04:01 AM UTC

    During development work to accommodate for a new contributor address supply, changes were made to the daily processing database. Although there was a level of confidence that any development work would not affect production activities, investigations led us to the database change. The change was corrected and the data load process was run manually \(which takes some time to complete\). The completeness of the WA dataset was checked in PROD SUPPORT and then pushed to the PROD environment \(less than 30 mins later\).