Groove incident

Delays in incoming email processing (gmail)

Minor Resolved View vendor source →

Groove experienced a minor incident on June 2, 2019 affecting Inbox API, lasting 4h 40m. The incident has been resolved; the full update timeline is below.

Started
Jun 02, 2019, 07:31 PM UTC
Resolved
Jun 03, 2019, 12:12 AM UTC
Duration
4h 40m
Detected by Pingoru
Jun 02, 2019, 07:31 PM UTC

Affected components

Inbox API

Update timeline

  1. investigating Jun 02, 2019, 07:31 PM UTC

    We're experiencing delays in processing incoming emails from Gmail. We're investigating a possible relation to current Google issues.

  2. investigating Jun 02, 2019, 07:54 PM UTC

    We are continuing to investigate the issue. Gmail mail processing is delayed, however forwarded inboxes continue to function regularly.

  3. monitoring Jun 02, 2019, 07:57 PM UTC

    We have narrowed the issue to the ongoing Google outage. We're monitoring the situation. As soon as the Google outage is resolved, the delayed emails will be loaded into Groove.

  4. monitoring Jun 02, 2019, 08:44 PM UTC

    We continue to monitor the situation. Google has updated their status page with more information on the outage: https://www.google.com/appsstatus#hl=en-GB&v=issue&sid=1&iid=74a7efa47b9de665d02699bbe9dd11fc Latest update from Google: "Our team is continuing to investigate this issue. We will provide an update by 02/06/2019 23:33 with more information about this problem. Thank you for your patience. We are experiencing high levels of network congestion in the eastern USA, affecting multiple service in Google Cloud, GSuite and YouTube. Users may see slow performance or intermittent errors. We believe we have identified the root cause of the congestion and expect to return to normal service shortly."

  5. monitoring Jun 02, 2019, 11:07 PM UTC

    We continue to monitor the situation. Google has updated their status page but provided no ETA on resolution: https://www.google.com/appsstatus#hl=en&v=issue&sid=1&iid=74a7efa47b9de665d02699bbe9dd11fc

  6. resolved Jun 03, 2019, 12:12 AM UTC

    Gmail has advised resolution of their issue. Groove is processing incoming emails from Gmail again normally.