GoTab incident

Slow POS login

Resolved on April 6, 2025.

resolved Apr 12, 2025, 11:11 AM UTC

On 4/6/25, a number of customers reported experiencing intermittent slow login to the POS after PIN entry, followed by a prolonged loading screen. In some cases, a subset of customers also reported seeing a blank screen after logging into the POS. The issue was traced to latency in receiving responses from our Redis caching database. An investigation revealed a significant number of blocking calls that caused some requests to be paused while previous requests were being serviced. Our engineers increased resource allocation to the database as an immediate measure of relief and subsequently optimized the usage of Redis within our applications to reduce the number of calls and to also reduce the size of stored payloads. This optimization took place incrementally between 4/7/25 and 4/10/25, during which time we observed performance improvements on the order of several magnitudes.

Started
Apr 06, 2025, 01:30 PM UTC
Resolved
Apr 06, 2025, 01:30 PM UTC
Duration
–
Detected by Pingoru
Apr 06, 2025, 01:30 PM UTC

Update timeline

  1. resolved Apr 12, 2025, 11:11 AM UTC

    On 4/6/25, a number of customers reported experiencing intermittent slow login to the POS after PIN entry, followed by a prolonged loading screen. In some cases, a subset of customers also reported seeing a blank screen after logging into the POS. The issue was traced to latency in receiving responses from our Redis caching database. An investigation revealed a significant number of blocking calls that caused some requests to be paused while previous requests were being serviced. Our engineers increased resource allocation to the database as an immediate measure of relief and subsequently optimized the usage of Redis within our applications to reduce the number of calls and to also reduce the size of stored payloads. This optimization took place incrementally between 4/7/25 and 4/10/25, during which time we observed performance improvements on the order of several magnitudes.

Your product runs on more than GoTab

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →