Populi incident

Internet routing issues

Major Resolved View vendor source →

Populi experienced a major incident on July 22, 2024 affecting Main Application and API and 1 more component, lasting 3h 24m. The incident has been resolved; the full update timeline is below.

Started
Jul 22, 2024, 11:53 PM UTC
Resolved
Jul 23, 2024, 03:18 AM UTC
Duration
3h 24m
Detected by Pingoru
Jul 22, 2024, 11:53 PM UTC

Affected components

Main ApplicationAPISearchMedia EncodingEmailSMS

Update timeline

  1. investigating Jul 22, 2024, 11:53 PM UTC

    Populi is currently unavailable from several larger network providers such as Comcast... this appears to be a widespread Internet problem and our datacenter is fine (just unreachable for many users). We are continuing to investigate and will post updates here...

  2. monitoring Jul 23, 2024, 12:41 AM UTC

    The issue appears to have been with an Internet connection into Populi's primary datacenter - failover has occurred and we're seeing usage statistics return to normal. We'll continue to monitor....

  3. monitoring Jul 23, 2024, 01:12 AM UTC

    Traffic from all internet providers looks good but we will continue to monitor for a while before resolving this incident... thanks for your patience!

  4. resolved Jul 23, 2024, 03:18 AM UTC

    Everything continues to look good, so we're closing this incident.