MJ Platform incident

Investigating Potential Issue

Notice Resolved View vendor source →

MJ Platform experienced a notice incident on September 18, 2023 affecting Retail and Manufacturing and 1 more component, lasting 18h 24m. The incident has been resolved; the full update timeline is below.

Started
Sep 18, 2023, 05:36 PM UTC
Resolved
Sep 19, 2023, 12:01 PM UTC
Duration
18h 24m
Detected by Pingoru
Sep 18, 2023, 05:36 PM UTC

Affected components

RetailManufacturingCultivation

Update timeline

  1. investigating Sep 18, 2023, 05:36 PM UTC

    We have a report of a potential issue with MJ Platform. We are investigating and will update this page as soon as we know more.

  2. investigating Sep 18, 2023, 06:28 PM UTC

    We are continuing to investigate this issue and will update again once we have more information.

  3. identified Sep 18, 2023, 11:34 PM UTC

    We have identified the issue to be AWS related and received the following update from AWS: Network Connectivity Issues [01:11 PM PDT] We continue to make progress towards resolving the increased networking latencies and errors affecting Availability Zones (usw2-az1 and usw2-az2) in the US-WEST-2 Region. The issue affects some instances in each of these Availability Zones, where network mappings are not being propagated to the underlying hardware. We are working directly with AWS to fix these issues and will continue to update as we know more.

  4. identified Sep 19, 2023, 03:51 AM UTC

    As we wait for resolution from AWS, the latest update they have posted is as follows: [07:27 PM PDT] We continue to work toward resolving the increased networking latencies and errors affecting Availability Zones (usw2-az1 and usw2-az2) in the US-WEST-2 Region. We have now completed all updates to mitigate the resource contention being experienced by the subsystem responsible for network mapping propagation. We're seeing early signs of improvements as the system works through the backlog of network mapping propagations. We expect to see network mapping propagation latencies continue to recover over the next 2 hours, but will keep you updated on progress. Once they resolve this issue, MJ Platform should be operational.

  5. resolved Sep 19, 2023, 12:01 PM UTC

    This incident has been resolved.