Vero incident

Delay in updating user properties for segmentation

Minor Resolved View vendor source →

Vero experienced a minor incident on February 17, 2022 affecting Vero 1.0: Segment calculation, lasting 1d 17h. The incident has been resolved; the full update timeline is below.

Started
Feb 17, 2022, 06:56 AM UTC
Resolved
Feb 19, 2022, 12:09 AM UTC
Duration
1d 17h
Detected by Pingoru
Feb 17, 2022, 06:56 AM UTC

Affected components

Vero 1.0: Segment calculation

Update timeline

  1. identified Feb 17, 2022, 06:56 AM UTC

    On February 15th at 08:57:01 (GMT+11) we deployed an update to the data platform used to calculate large segment queries as part of routine upgrades we have been making to support our security posture. Unfortunately these upgrades introduced an error that resulted in new and updated user property values not being updated in this data platform. This was ongoing from Feb 15 at 08:57am (GMT+11) to Feb 17 at 04:58am (GMT+11). During this window, segments continued to refresh without issues but customers whose segments utilise this data platform queried potentially stale data. We have identified and fixed the issue and are in the process of fully backfilling all user property updates, this should be complete within 10-24 hours. No data has been lost but refreshed segments may still be inaccurate until the backfill process has been completed. If you have any questions about your account please email [email protected]

  2. resolved Feb 19, 2022, 12:09 AM UTC

    All user property data is up to date for segmentation! Please email [email protected] if you have any questions related to your account.