Baremetrics incident

Dashboard availability issues

Major Resolved View vendor source →

Baremetrics experienced a major incident on February 5, 2018, lasting 7h 7m. The incident has been resolved; the full update timeline is below.

Started
Feb 05, 2018, 06:28 PM UTC
Resolved
Feb 06, 2018, 01:35 AM UTC
Duration
7h 7m
Detected by Pingoru
Feb 05, 2018, 06:28 PM UTC

Update timeline

  1. investigating Feb 05, 2018, 06:28 PM UTC

    We're having issues with availability and speed of the main metrics dashboard, potentially caused by a rogue database. Putting the app in maintenance mode while we investigate.

  2. identified Feb 05, 2018, 06:54 PM UTC

    We've found the issue and are working on rolling out the fix for it now.

  3. identified Feb 05, 2018, 07:02 PM UTC

    Bringing servers back online now. Will be a few more minutes before we come out of maintenance mode.

  4. investigating Feb 05, 2018, 08:11 PM UTC

    Were back for a bit, but our fix didn't hold, so going to do some digging. Putting the dashboard back in to maintenance mode.

  5. monitoring Feb 05, 2018, 10:23 PM UTC

    We're back up and stabilized. Working on the backlog of webhooks and data processing now.

  6. resolved Feb 06, 2018, 01:35 AM UTC

    All sorted, everyone is caught up. Thanks for your patience folks!