Fera incident

Database Migration

Major Resolved View vendor source →

Fera experienced a major incident on April 11, 2024 affecting Fera Management Portal and Public API and 1 more component, lasting 2h 33m. The incident has been resolved; the full update timeline is below.

Started
Apr 11, 2024, 03:30 PM UTC
Resolved
Apr 11, 2024, 06:03 PM UTC
Duration
2h 33m
Detected by Pingoru
Apr 11, 2024, 03:30 PM UTC

Affected components

Fera Management PortalPublic APICustomer MessagesPrivate APISyncs

Update timeline

  1. identified Apr 11, 2024, 04:20 PM UTC

    Having problems during a database upgrade. Working on ensuring everything is back to normal.

  2. monitoring Apr 11, 2024, 05:03 PM UTC

    Issues are fixed and we are now just monitoring and catching up on background workers. Things should be back to normal on their own soon.

  3. monitoring Apr 11, 2024, 05:36 PM UTC

    Still just catching up on old messages scheduled to send and old data syncs. About 30min behind so far on data syncs.

  4. resolved Apr 11, 2024, 06:03 PM UTC

    This incident has been resolved.