Tideways incident

Outage of email provider and UI performance degradation

Minor Resolved View vendor source →

Tideways experienced a minor incident on September 16, 2024 affecting User Interface and Ecosystem, lasting 3h 41m. The incident has been resolved; the full update timeline is below.

Started
Sep 16, 2024, 06:58 AM UTC
Resolved
Sep 16, 2024, 10:40 AM UTC
Duration
3h 41m
Detected by Pingoru
Sep 16, 2024, 06:58 AM UTC

Affected components

User InterfaceEcosystem

Update timeline

  1. investigating Sep 16, 2024, 06:58 AM UTC

    We are currently experiencing issues with sending emails from our system, due to an outage of our SMTP provider. We are in contact with them and will update you on the situation. We also experience slow loading times of our UI right now and are investigating the cause. Data Collection and backend performance are completely normal though, so we do not expect any data gaps here. UI loading issues might be related to this Cloudflare incident: https://www.cloudflarestatus.com/incidents/f116htkkp7hn

  2. identified Sep 16, 2024, 08:16 AM UTC

    UI performance has returned back to normal. Outbound emails are still not working properly: our SMTP provider is currently working on a fix, while we are looking into a workaround to the issue.

  3. monitoring Sep 16, 2024, 08:25 AM UTC

    Outbound emails are back to working, we have just deployed a workaround. We will keep monitoring the situation.

  4. resolved Sep 16, 2024, 10:40 AM UTC

    All systems are back to normal, the issue with our email provider was completely resolved and our workaround rolled back. Thank you for your patience.