Prismatic incident

Prismatic Web Application Hard Crashing

Notice Resolved View vendor source →

Prismatic experienced a notice incident on December 17, 2024, lasting 3m. The incident has been resolved; the full update timeline is below.

Started
Dec 17, 2024, 03:56 PM UTC
Resolved
Dec 17, 2024, 04:00 PM UTC
Duration
3m
Detected by Pingoru
Dec 17, 2024, 03:56 PM UTC

Update timeline

  1. resolved Dec 17, 2024, 03:56 PM UTC

    At approximately 8:57am CT an update to the Prismatic web application was deployed that contained updated dependencies. Unfortunately there was a misconfiguration that was not problematic in development and CI environments, but caused crashes in the production environments. The Prismatic engineering team received alerts immediately upon release that there were problems and immediately started rolling back to the previous version. Full functionality was restored by 9:30am CT. The Prismatic engineering team is investigating root cause and will properly address this issue and further investigate how to improve the test coverage so as to minimize the likelihood and impact of similar situations in the future.