CCLI incident

Legacy SS API is struggling with Sunday morning load

Minor Resolved View vendor source →

CCLI experienced a minor incident on April 2, 2023, lasting 41m. The incident has been resolved; the full update timeline is below.

Started
Apr 02, 2023, 01:44 PM UTC
Resolved
Apr 02, 2023, 02:26 PM UTC
Duration
41m
Detected by Pingoru
Apr 02, 2023, 01:44 PM UTC

Update timeline

  1. investigating Apr 02, 2023, 01:44 PM UTC

    This only affects the legacy SS API (the new API is working well). The fix we had put in place for the legacy SS API last week is working, but has apparently increased the need for system resources so we are increasing server instances and monitoring as they come online. .

  2. monitoring Apr 02, 2023, 02:16 PM UTC

    The extra servers are helping and the API is usually responding, but performance is still poor as we are in the heaviest of Sunday morning load. Once again, this only impacts the legacy SS API, and the new API is performing well. Customers may download resources directly from SongSelect or upgrade partner software if it yet supports the new API..

  3. resolved Apr 02, 2023, 02:26 PM UTC

    This incident appears to be resolved..