Geoscape Australia incident

Predictive API suggestion query timeouts

Notice Resolved View vendor source →

Geoscape Australia experienced a notice incident on November 18, 2019 affecting Predictive API, lasting 1h 21m. The incident has been resolved; the full update timeline is below.

Started
Nov 18, 2019, 03:31 AM UTC
Resolved
Nov 18, 2019, 04:53 AM UTC
Duration
1h 21m
Detected by Pingoru
Nov 18, 2019, 03:31 AM UTC

Affected components

Predictive API

Update timeline

  1. identified Nov 18, 2019, 03:31 AM UTC

    The issue has been identified and a fix is being implemented.

  2. identified Nov 18, 2019, 03:55 AM UTC

    We will be deploying a change in the next 15min to address the performance issue. If this does not resolve our request timeouts, we will be rolling back the V1.5.9 deployment from this morning. The rollback will be performed before 4 pm today if needed.

  3. resolved Nov 18, 2019, 04:53 AM UTC

    The change did not take effect soon enough for us to have confidence in the fix. As such we're rolling the V1.5.9 release back. We will deploy V1.5.9 at a later date (we'll update everyone through status page). I apologies for the impact today to you and your customers, we will be investigating how we can prevent this from happening again. Cheers Keenan Product Manager