EverTrue incident

EverTrue Platform - Platform Loading Issues and Slowed Imports

Major Resolved View vendor source →

EverTrue experienced a major incident on June 12, 2024 affecting Imports and Exports and 1 more component, lasting 13h 44m. The incident has been resolved; the full update timeline is below.

Started
Jun 12, 2024, 12:28 PM UTC
Resolved
Jun 13, 2024, 02:13 AM UTC
Duration
13h 44m
Detected by Pingoru
Jun 12, 2024, 12:28 PM UTC

Affected components

ImportsExportsApplication

Update timeline

  1. investigating Jun 12, 2024, 12:28 PM UTC

    We are investigating an issue that is causing general importer slowness, and platform loading issues for some users (pages may not load, some users may receive "Server Errors"). We apologize for the inconvenience and are working to identify the issue as quickly as possible. If you have any questions please reach out to [email protected]

  2. identified Jun 12, 2024, 01:02 PM UTC

    We have identified the issue and are working to restore regular platform performance. During this time we will be pausing import files temporarily, but will resume imports once platform stability has been restored. We apologize for any inconvenience this may cause. Please reach out to [email protected] if you have any questions.

  3. identified Jun 12, 2024, 01:41 PM UTC

    As we continue to work to resolve this issue, we will be temporarily pausing exports from EverTrue. Once platform stability is restored, any queued or failed exports will be regenerated. Please reach out to [email protected] if you have any questions.

  4. identified Jun 12, 2024, 01:46 PM UTC

    We are continuing to work on a fix for this issue.

  5. identified Jun 12, 2024, 01:56 PM UTC

    We are continuing to work on a fix for this issue.

  6. identified Jun 12, 2024, 03:37 PM UTC

    We have identified and are working to resolve the issue. Users will experience general slowness in the platform until the issue is resolved, and some users may receive server errors or pages may not load in full. We have temporarily paused Imports and Exports, which will resume once the issue has been resolved. We apologize for the continued issues and are working to resolve this as quickly as possible. We appreciate your patience with us, please reach out to [email protected] if you have any questions.

  7. monitoring Jun 12, 2024, 05:41 PM UTC

    A fix has been implemented and we are monitoring the results. During this time, imports and exports will remain paused, but will resume once we have confirmed the fix has resolved the platform performance issues. Please reach out to [email protected] if you have any questions.

  8. resolved Jun 13, 2024, 02:13 AM UTC

    This incident has been resolved. We thank you for your patience with us as we worked through this issue. Please reach out to [email protected] if you have any questions.