Noko incident

500 errors

Resolved after 4 hours 13 minutes, on December 1, 2014.

resolved Dec 01, 2014, 11:27 PM UTC

We've tuned some background processing to lighten the load and haven't seen 500 errors in several hours. We're marking this issue as solved, but will continue to keep an eye on it.

Started
Dec 01, 2014, 07:13 PM UTC
Resolved
Dec 01, 2014, 11:27 PM UTC
Duration
4h 13m
Detected by Pingoru
Dec 01, 2014, 07:13 PM UTC

Update timeline

  1. investigating Dec 01, 2014, 07:13 PM UTC

    We're again seeing 500 errors & are looking into it.

  2. monitoring Dec 01, 2014, 08:00 PM UTC

    We've rolled out a fix for the main cause of the 500 errors. Certain types of reports could cause our Unicorn server processes to become saturated with new request being denied. We'll monitor load and error occurrences and will update as necessary, though we don't expect any more issues.

  3. monitoring Dec 01, 2014, 08:06 PM UTC

    We still see occasional errors and are working on fixing these.

  4. monitoring Dec 01, 2014, 08:35 PM UTC

    Load is back to normal levels. We'll continue to monitor.

  5. resolved Dec 01, 2014, 11:27 PM UTC

    We've tuned some background processing to lighten the load and haven't seen 500 errors in several hours. We're marking this issue as solved, but will continue to keep an eye on it.

Your product runs on more than Noko

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →