Pike13 experienced a major incident on September 9, 2023 affecting Your Pike13 Website and Payment Processing and 1 more component, lasting 52d 5h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 07, 2023, 11:04 PM UTC
Pike13 and reporting tools are restored. Reporting and the Reporting API are still missing transaction data from Sept 4, 2023 to now. We are still working to make that data available.
- identified Sep 09, 2023, 05:26 PM UTC
New changes are making their way into reporting as of 5pm Pacific time today (Sept 8). We are still working on populating data from 9/4 - 9/8 5pm. Please rest assured that all data and transactions are in production and will be migrated over to reporting as soon as possible. We apologize for this disruption.
- identified Sep 13, 2023, 02:50 PM UTC
We are continuing to work on a fix for this issue.
- identified Sep 13, 2023, 02:54 PM UTC
Pike13 sites has been paused briefly in order to upscale resources being impacted by the reporting sync.
- identified Sep 13, 2023, 03:12 PM UTC
We are continuing to work on a fix for this issue.
- identified Sep 13, 2023, 04:01 PM UTC
Pike13 sites are operational.
- identified Sep 19, 2023, 05:59 PM UTC
A portion of the reporting infrastructure is under repair. We are using every resource available to expedite this, but expect the service to be down through the end of September. We are utilizing premium reporting and its connection to a different database to offer access to mission-critical data, like transaction reports. Contact [email protected] if you need access to this tool. The Core API is functioning, the reporting API does not have a complete data source.
- resolved Oct 31, 2023, 11:03 PM UTC
Regular Reporting and the reporting_api have returned to service.