Loops Outage History
Loops is up right nowPingoru has recorded 15 incidents for Loops: 5 in the last 12 months and 1 in the last 90 days.
Show as a table
| Month | Incidents | Hours with an open incident |
|---|---|---|
| April 2026 | 0 | 0 of 720 (0%) |
| May 2026 | 0 | 0 of 744 (0%) |
| June 2026 | 0 | 0 of 720 (0%) |
| July 2026 | 0 | 0 of 744 (0%) |
| August 2026 | 0 | 0 of 744 (0%) |
| September 2026 | 1 | 2 of 720 (0%) |
| October 2026 | 0 | 0 of 744 (0%) |
| November 2026 | 0 | 0 of 9 (0%) |
Incidents, newest first
Minor September 11, 2026 Delay in email metric processing 1h 33m App
Started Sep 11, 2026, 01:16 PM UTC· resolved Sep 11, 2026, 02:49 PM UTC
- investigating Sep 11, 2026, 01:16 PM UTC
Email metrics may be slow to appear or not appear on refresh. We are currently investigating the issue.
- identified Sep 11, 2026, 02:40 PM UTC
We're continuing to make progress processing a backlog of email metrics.
- resolved Sep 11, 2026, 02:49 PM UTC
The metrics processing pipeline has caught up. No metrics were lost, this was only a delay in processing.
Major March 2, 2026 increased rate of 500 level responses 45m API, App
Started Mar 02, 2026, 10:58 PM UTC· resolved Mar 02, 2026, 11:44 PM UTC
- investigating Mar 02, 2026, 10:58 PM UTC
We are currently investigating this issue.
- identified Mar 02, 2026, 11:09 PM UTC
The issue has been identified and a fix is being implemented.
- resolved Mar 02, 2026, 11:44 PM UTC
This incident has been resolved.
Minor February 10, 2026 Webhook Delivery Delayed 3h 45m Webhooks
Started Feb 10, 2026, 02:51 PM UTC· resolved Feb 10, 2026, 06:36 PM UTC
- investigating Feb 10, 2026, 02:51 PM UTC
We are currently investigating this issue.
- identified Feb 10, 2026, 04:39 PM UTC
We are currently working through the backlog of webhook messages.
- monitoring Feb 10, 2026, 05:22 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Feb 10, 2026, 06:36 PM UTC
This incident has been resolved.
Minor January 24, 2026 Elevated error rates for app.loops.so 1h 17m Loops, API, Campaigns, App and 3 more
Started Jan 24, 2026, 07:49 AM UTC· resolved Jan 24, 2026, 09:07 AM UTC
- investigating Jan 24, 2026, 07:49 AM UTC
We are currently investigating this issue.
- monitoring Jan 24, 2026, 08:58 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jan 24, 2026, 09:07 AM UTC
This incident has been resolved.
Minor November 18, 2025 Elevated error rates for app.loops.so 3h 24m API, App, SMTP Relay, Webhooks
Started Nov 18, 2025, 12:13 PM UTC· resolved Nov 18, 2025, 03:37 PM UTC
- investigating Nov 18, 2025, 12:13 PM UTC
We are currently investigating Cloudflare related 500's at app.loops.so.
- identified Nov 18, 2025, 12:15 PM UTC
An upstream issue has been identified with Cloudflare. https://www.cloudflarestatus.com/incidents/8gmgl950y3h7
- identified Nov 18, 2025, 12:24 PM UTC
We are continuing to work on a fix for this issue.
- identified Nov 18, 2025, 12:55 PM UTC
We are continuing to work on a fix for this issue.
- monitoring Nov 18, 2025, 02:45 PM UTC
A fix has been implemented and we are monitoring the results.
- monitoring Nov 18, 2025, 03:01 PM UTC
Despite an initial suggestion that the issue was resolved at Cloudflare. We're still seeing a handful of errors.
- resolved Nov 18, 2025, 03:37 PM UTC
This incident has been resolved.
Major October 20, 2025 Transactional email, webhooks, SMTP interruptions 2h 16m Transactional
Started Oct 20, 2025, 08:30 AM UTC· resolved Oct 20, 2025, 10:47 AM UTC
- monitoring Oct 20, 2025, 08:30 AM UTC
An issue in AWS is causing transactional emails to fail.
- monitoring Oct 20, 2025, 09:55 AM UTC
We are continuing to monitor for any further issues.
- monitoring Oct 20, 2025, 10:46 AM UTC
We are continuing to monitor for any further issues.
- resolved Oct 20, 2025, 10:47 AM UTC
This incident has been resolved.
- postmortem Oct 21, 2025, 05:22 PM UTC
On October 20 2025, Loops was impacted by AWS’s outage in the US-EAST-1 region. We observed a variety of misbehaviors during that time, some more serious than others. Overall, the impact to Loops fell within the wider window provided by AWS \(06:49 UTC to 22:53 UTC\). During the outage, we experienced temporary but notable impact to, * Transactional email sending. * Webhook delivery. * Incoming request routing to our SMTP service. **Transactional email** Between 7:02 UTC and 9:18 UTC, transactional email sending was impacted. During this window the Loops API may have accepted transactional requests but failed to send them. Impacted messages were not resent later as we do not store the raw payloads. Timeline: * 7:02 UTC: We began experiencing elevated error rates related to transactional email sending, manifesting as increasing rates of HTTP 500 responses from AWS APIs. * 9:18 UTC: AWS API error rates subside. Transactional sending returns to normal. **Webhooks** Between 9:30 UTC and 10:31 UTC webhook delivery was impacted due to the inability to provision sufficient EC2 capacity. Timeline: * 9:30 UTC: Error rates between the Loops API and our backend webhooks service rise. * 10:01 UTC: The issue is identified as insufficient capacity for the webhooks service due to EC2 provisioning scarcity. * 10:31 UTC: Error rates subside as we change our autoscaling configurations to accept a wider range of EC2 instance types and sizes. **SMTP availability** Between approximately 19:33 UTC and 21:35 UTC an incorrect DNS entry was returned in the results for the network load balancer \(NLB\) used by our SMTP service. During this window, one of three IP addresses returned by DNS responses were unable to accept connections. Attempts to connect to the incorrect IP address manifested as timeouts. Timeline: * ~19:33 UTC: An IP address returned NLB DNS requests stops accepting connections. DNS requests that select the impacted IP address fail to connect and time out. * ~21:35 UTC: The DNS for the NLB corrects itself and begins returning correct responses.
Minor October 14, 2025 Outbound Webhooks 46m Webhooks
Started Oct 14, 2025, 01:57 PM UTC· resolved Oct 14, 2025, 02:43 PM UTC
- investigating Oct 14, 2025, 01:57 PM UTC
We are investigating issues with delivery of outbound webhooks
- resolved Oct 14, 2025, 02:43 PM UTC
This incident has been resolved.
- postmortem Oct 14, 2025, 02:44 PM UTC
Between approximately 13:42 and 14:18 UTC attempted webhook deliveries failed while our webhooks database was unavailable due to an unplanned outage. Webhooks messages during that period were lost and will not be delivered. We’ve prioritized work to make webhooks more resilient to this sort of failure. Email message sending was not impacted during this event.
Major September 3, 2025 Increased 500 errors 30m Loops, API, Campaigns, App and 3 more
Started Sep 03, 2025, 08:14 AM UTC· resolved Sep 03, 2025, 08:44 AM UTC
- investigating Sep 03, 2025, 08:14 AM UTC
We are currently investigating this issue.
- identified Sep 03, 2025, 08:33 AM UTC
The issue has been identified and a fix is being implemented.
- monitoring Sep 03, 2025, 08:38 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Sep 03, 2025, 08:44 AM UTC
This incident has been resolved.
- postmortem Sep 04, 2025, 02:00 PM UTC
Between Sept 3 03:40 UTC and Sept 3 08:30 UTC Loops experienced a period of elevated error rates where API requests intermittently returned 500’s due to high CPU use on our primary database. We resolved the issue and additionally made monitoring and process changes to speed responses in the future.
Minor August 20, 2025 increased rate of 500 level responses 1h 21m Loops, API, Campaigns, App and 2 more
Started Aug 20, 2025, 05:30 PM UTC· resolved Aug 20, 2025, 06:51 PM UTC
- investigating Aug 20, 2025, 05:30 PM UTC
We are currently investigating this issue.
- investigating Aug 20, 2025, 05:45 PM UTC
we have applied a change and are continuing to monitor
- resolved Aug 20, 2025, 06:51 PM UTC
This incident has been resolved.
Major April 22, 2025 Increased 500 status codes 1h 17m Loops, API, Campaigns, App and 2 more
Started Apr 22, 2025, 06:13 PM UTC· resolved Apr 22, 2025, 07:31 PM UTC
- investigating Apr 22, 2025, 06:13 PM UTC
We are currently investigating this issue.
- monitoring Apr 22, 2025, 06:41 PM UTC
A fix has been implemented and we are monitoring the results. Email queues will be processed shortly for Loops and Campaigns.
- resolved Apr 22, 2025, 07:31 PM UTC
This incident has been resolved.
Minor March 12, 2025 Delays in sending email 6h 36m Loops, API, Campaigns, Transactional
Started Mar 12, 2025, 05:12 PM UTC· resolved Mar 12, 2025, 11:48 PM UTC
- investigating Mar 12, 2025, 05:12 PM UTC
Marketing email sending queues are delayed in processing their payloads. We are currently investigating this issue.
- investigating Mar 12, 2025, 07:51 PM UTC
We are continuing to investigate this issue.
- identified Mar 12, 2025, 08:22 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Mar 12, 2025, 09:18 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Mar 12, 2025, 11:48 PM UTC
This incident has been resolved.
Minor February 28, 2025 Email sending delay 6h 9m Loops, API, Campaigns
Started Feb 28, 2025, 10:09 AM UTC· resolved Feb 28, 2025, 04:19 PM UTC
- investigating Feb 28, 2025, 10:09 AM UTC
Campaigns, loops, and their preview emails are successfully being added to our worker queues, but there is a delay in processing the jobs. Contact updates and transactional email endpoints unlikely to be impacted. We are currently investigating this issue.
- identified Feb 28, 2025, 02:46 PM UTC
The issue has been identified and a fix is being implemented.
- monitoring Feb 28, 2025, 03:00 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Feb 28, 2025, 04:19 PM UTC
This incident has been resolved.
Notice January 29, 2025 Intermittent 500 Errors 1h 51m Loops, API, Campaigns, App and 2 more
Started Jan 29, 2025, 04:05 PM UTC· resolved Jan 29, 2025, 05:57 PM UTC
- investigating Jan 29, 2025, 04:05 PM UTC
We are investigating an issue with an upstream provider, we're working to mitigate the impact.
- monitoring Jan 29, 2025, 05:19 PM UTC
We're seeing signs of recovery and continuing to monitor while we wait for an "all-clear" from our upstream provider.
- resolved Jan 29, 2025, 05:57 PM UTC
All good!
Notice November 8, 2024 High Latency 1h 56m Loops, API, Campaigns, App and 2 more
Started Nov 08, 2024, 12:38 AM UTC· resolved Nov 08, 2024, 02:34 AM UTC
- investigating Nov 08, 2024, 12:38 AM UTC
We are currently investigating this issue.
- monitoring Nov 08, 2024, 12:55 AM UTC
The issue is resolved and we are monitoring.
- resolved Nov 08, 2024, 02:34 AM UTC
This incident has been resolved.