Localytics incident

Dashboard Experiencing Chart Loading Issues

Major Resolved View vendor source →

Localytics experienced a major incident on August 11, 2016, lasting 26m. The incident has been resolved; the full update timeline is below.

Started
Aug 11, 2016, 08:41 PM UTC
Resolved
Aug 11, 2016, 09:08 PM UTC
Duration
26m
Detected by Pingoru
Aug 11, 2016, 08:41 PM UTC

Update timeline

  1. investigating Aug 11, 2016, 08:41 PM UTC

    Our dashboard is currently not loading charts. We aren't yet sure what's causing it, but our team is actively investigating.

  2. investigating Aug 11, 2016, 08:45 PM UTC

    It appears this issue is also impacting the Query API. Our team is continuing to investigate the situation.

  3. identified Aug 11, 2016, 08:48 PM UTC

    We have identified the back-end issue that's impacting charts and the QueryAPI. No timing for a fix just yet.

  4. identified Aug 11, 2016, 08:51 PM UTC

    We have made some adjustments to our backend systems as a temporary fix. Charts should be loading on the dashboard, but you might experience long load times.

  5. monitoring Aug 11, 2016, 09:00 PM UTC

    It appears that we are back to processing queries as normal. All charts should be loading at a normal speed and the Query API should be back as well. The team will continue to monitor the situation.

  6. resolved Aug 11, 2016, 09:08 PM UTC

    This incident has been resolved. The problem was traced to a hardware failure. The failed component has been replaced and all systems are once again operating normally. Despite the issues with the dashboard, no data was lost during this outage and scheduled messaging campaigns continued to be sent.