Pepperi incident

Amazon Web Services (AWS) Connectivity Issues affecting Pepperi

Major Resolved View vendor source →

Pepperi experienced a major incident on October 31, 2021 affecting WebAdmin (Studio) - US and Mobile Apps Sync Interface - US and 1 more component, lasting 7h 3m. The incident has been resolved; the full update timeline is below.

Started
Oct 31, 2021, 05:00 AM UTC
Resolved
Oct 31, 2021, 12:03 PM UTC
Duration
7h 3m
Detected by Pingoru
Oct 31, 2021, 05:00 AM UTC

Affected components

WebAdmin (Studio) - USMobile Apps Sync Interface - USWebAdmin (Studio) - EUMobile Apps Sync Interface - EUPepperi Integration PlatformPepperi Online IntegrationPepperi API - USPepperi API - EUPepperi - WebappPepperi Integration Online API

Update timeline

  1. investigating Oct 31, 2021, 06:52 AM UTC

    Amazon Web Services (AWS) are having connectivity issues in their Oregon data center at the moment. We regret to inform you that this is affecting Pepperi services. Pepperi may currently only be used offline on mobile devices. We apologize for this inconvenience and we will update you once AWS resolves the issue.

  2. investigating Oct 31, 2021, 06:57 AM UTC

    Amazon Web Services (AWS) support has confirmed degraded performance and connectivity of several EBS volumes in US-West-2 Region, which affect Pepperi services. We will keep you updated.

  3. identified Oct 31, 2021, 06:58 AM UTC

    AWS engineers are working on a resolution.

  4. identified Oct 31, 2021, 07:00 AM UTC

    We are continuing to work on a fix for this issue.

  5. identified Oct 31, 2021, 07:57 AM UTC

    AWS has identified a failed network device causing degraded performance for a small number of EBS volumes in a single Availability Zone (usw2-az2) in the US-WEST-2 Region. They are continuing to work towards resolution.

  6. monitoring Oct 31, 2021, 09:37 AM UTC

    AWS has updated that between October 30 22:50 PM UTC and October 31 08:51 AM UTC they experienced degraded performance for a small number of EBS volumes in a single Availability Zone (usw2-az2) in the US-WEST-2 Region. The issue has been resolved and the service is operating normally. Pepperi is back online. Customers may experience lag for a short while due to increased incoming traffic after the downtime.

  7. monitoring Oct 31, 2021, 10:58 AM UTC

    Customers are suffering from slowness in Pepperi WebApp and mobile. We are working to fix the issue.

  8. resolved Oct 31, 2021, 12:03 PM UTC

    All Pepperi platforms (WebApp and Mobile) are stable and back to normal.