Wisely experienced a minor incident on October 16, 2023 affecting Wisely Data Science and GEO (Wisely) Tableau-Snowflake Database, lasting 2d 7h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 16, 2023, 04:52 PM UTC
We are experiencing issues with our data pipeline, resulting in data inconsistencies within the Engage Reporting Suite and in the Engage Client Share experience. We are actively investigating these issues, and will follow up once we have more information.
- identified Oct 16, 2023, 05:52 PM UTC
We have identified the cause of data delays in Engage reports. Our team is developing a plan to remediate the root cause and ensure successful backload of the delayed data.
- identified Oct 16, 2023, 05:55 PM UTC
We are continuing to work on a fix for this issue.
- identified Oct 16, 2023, 07:27 PM UTC
We are continuing to work on a fix for this issue.
- identified Oct 16, 2023, 08:04 PM UTC
We are continuing to work on a fix for this issue.
- monitoring Oct 16, 2023, 09:52 PM UTC
We have identified an upstream issue that caused data from Oct 12 forward to be inaccurate. We have implemented a backfill to restore this data that will take some time to propagate - at least overnight and into tomorrow. We will then move on to validating the data propagation and will update status here tomorrow morning by 10am.
- monitoring Oct 17, 2023, 01:59 PM UTC
We continue to monitor our data backfill process and will provide further updates as we progress.
- monitoring Oct 18, 2023, 12:14 AM UTC
We are continuing to monitor our data backfill process. Data integrity has improved since this morning, but the backfill process has still not yet completed. We will provide another update by 10am ET tomorrow morning.
- monitoring Oct 18, 2023, 01:46 PM UTC
We continue to monitor our data backfill process and will provide an update later today on progress.
- resolved Oct 18, 2023, 11:53 PM UTC
Our data integrity issues are resolved and we've completed our data backfill process.