Replicate incident
Degraded scale-out due to failed setups pulling from huggingface
Replicate experienced a minor incident on July 31, 2026 affecting A100 Hardware and L40S Hardware and 1 more component, lasting —. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Jul 31, 2026, 09:25 PM UTC
Status: Identified Models that pull from huggingface during setup have not been succeeding, which is resulting in scale-out delays and queue backups. Affected components A100 Hardware (Degraded performance) H100 Hardware (Degraded performance) L40S Hardware (Degraded performance)
- identified Jul 31, 2026, 09:26 PM UTC
Status: Identified We have confirmed that turning off our caching layer for huggingface downloads allows models to successfully set up, so we are making that change for all models while we continue to troubleshoot. Affected components H100 Hardware (Degraded performance) L40S Hardware (Degraded performance) A100 Hardware (Degraded performance)
- monitoring Jul 31, 2026, 10:27 PM UTC
Status: Monitoring All affected hardware types have recovered and we are continuing to monitor and troubleshoot. Thanks for your patience! Affected components H100 Hardware (Operational) L40S Hardware (Operational) A100 Hardware (Operational)
- resolved Jul 31, 2026, 11:39 PM UTC
Status: Resolved We're looking stable now, and with caching back on. Thanks again for your patience! Affected components A100 Hardware (Operational) H100 Hardware (Operational) L40S Hardware (Operational)