Semaphore incident

Network congestion on route to AWS ECR us-east region

Minor Resolved View vendor source →

Semaphore experienced a minor incident on November 6, 2025 affecting Semaphore, lasting 14h 24m. The incident has been resolved; the full update timeline is below.

Started
Nov 06, 2025, 04:51 PM UTC
Resolved
Nov 07, 2025, 07:15 AM UTC
Duration
14h 24m
Detected by Pingoru
Nov 06, 2025, 04:51 PM UTC

Affected components

Semaphore

Update timeline

  1. investigating Nov 06, 2025, 04:51 PM UTC

    Operations towards the AWS US-East region might present some slowness. We are currently investigating this issue.

  2. investigating Nov 06, 2025, 05:22 PM UTC

    We are continuing to investigate this issue.

  3. investigating Nov 06, 2025, 05:50 PM UTC

    We are continuing to investigate this issue.

  4. investigating Nov 06, 2025, 06:33 PM UTC

    Some operations in the AWS US-East region may be experiencing slow performance. Our team is still investigating.

  5. investigating Nov 06, 2025, 07:05 PM UTC

    We are continuing to investigate this issue.

  6. investigating Nov 06, 2025, 07:58 PM UTC

    We are continuing to investigate this issue.

  7. investigating Nov 06, 2025, 08:49 PM UTC

    We have observed slight improvements in the operations towards the AWS US-East region. We are continuing to work on this issue.

  8. investigating Nov 06, 2025, 09:02 PM UTC

    Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue. We are continuing to monitor the AWS US-East region slowness.

  9. investigating Nov 06, 2025, 09:40 PM UTC

    Our team is still monitoring the AWS US-East region slowness. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  10. investigating Nov 06, 2025, 10:31 PM UTC

    Performance in AWS US-East region is showing gradual recovery. Our team continues to monitor the situation. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  11. investigating Nov 06, 2025, 11:02 PM UTC

    We are continuing to monitor the AWS US-East region slowness. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  12. investigating Nov 06, 2025, 11:30 PM UTC

    We are continuing to follow up the AWS US-East region slowness issue. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  13. investigating Nov 07, 2025, 12:03 AM UTC

    Our team is following up the slight recovery in AWS US-East region. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  14. investigating Nov 07, 2025, 12:36 AM UTC

    Our team is still monitoring the AWS US-East region performance. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  15. investigating Nov 07, 2025, 01:07 AM UTC

    Increased network congestion detected in the AWS US-East region. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  16. investigating Nov 07, 2025, 01:48 AM UTC

    We are continuing to monitor the AWS US-East region slowness. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  17. investigating Nov 07, 2025, 02:29 AM UTC

    We are continuing to monitor the AWS US-East network congestion. Connections to us-west, ap-northeast, and GCP are performing normally. If your workflows are affected, pushing/pulling data to and from these regions should help mitigate the issue.

  18. resolved Nov 07, 2025, 07:15 AM UTC

    We have observed connection times recover and stay healthy for the affected regions.