Replicon incident

Elevated errors on Polaris

Major Resolved View vendor source →

Replicon experienced a major incident on December 15, 2023 affecting na3 and na4 and 1 more component, lasting 3h 21m. The incident has been resolved; the full update timeline is below.

Started
Dec 15, 2023, 12:37 AM UTC
Resolved
Dec 15, 2023, 03:59 AM UTC
Duration
3h 21m
Detected by Pingoru
Dec 15, 2023, 12:37 AM UTC

Affected components

na3na4na5na6na8na9na12eu1eu2eu3

Update timeline

  1. investigating Dec 15, 2023, 12:37 AM UTC

    We're experiencing an elevated level of internal errors that may be impacting customers viewing their data in Polaris . Our engineering teams are currently looking into the issue. We will post updates as soon as we have more information.

  2. investigating Dec 15, 2023, 12:40 AM UTC

    We are continuing to investigate this issue.

  3. identified Dec 15, 2023, 01:08 AM UTC

    We believe we have identified the issue and are currently testing a fix.

  4. identified Dec 15, 2023, 01:22 AM UTC

    Fix has been confirmed we are in the process of pushing this out to all environments. ETA for recovery is around 45 minutes.

  5. monitoring Dec 15, 2023, 02:57 AM UTC

    A fix has been implemented and we are monitoring the results.

  6. resolved Dec 15, 2023, 03:59 AM UTC

    This incident has been resolved.