ShipHero incident

Totes not clearing on ship

Major Resolved View vendor source →

ShipHero experienced a major incident on August 3, 2023 affecting Label Printing, lasting 6h 19m. The incident has been resolved; the full update timeline is below.

Started
Aug 03, 2023, 06:07 PM UTC
Resolved
Aug 04, 2023, 12:26 AM UTC
Duration
6h 19m
Detected by Pingoru
Aug 03, 2023, 06:07 PM UTC

Affected components

Label Printing

Update timeline

  1. investigating Aug 03, 2023, 06:07 PM UTC

    Totes are not clearing after label generation. We're investigating.

  2. identified Aug 03, 2023, 06:14 PM UTC

    We believe we have identified the issue and are working to have a resolution in place in 15 minutes. We will update in 15 minutes.

  3. identified Aug 03, 2023, 06:28 PM UTC

    Fixed for all new shipments. DO NOT CLEAR THE AFFECTED TOTES. We're going to reprocess and clear the totes. If you clear the totes it will cause the data from the totes to be loss. Please don't clear the affected totes, we'll reprocess, clear the totes and post an update when fully reprocessed.

  4. identified Aug 03, 2023, 07:38 PM UTC

    We're still working on recovering the data to fix the old totes. Don't clear the totes and don't set the orders as fulfilled. We'll get those fixed as quickly as possible.

  5. monitoring Aug 03, 2023, 09:25 PM UTC

    The code that is processing the totes is running now. You may seem some totes fixed and some not. We'll update when all are fixed. Don't clear the totes and don't set the orders as fulfilled. If you clear the tote manually or set the order as fulfilled manually, your data will be wrong including the potential for inventory not being deducted for that shipment.

  6. monitoring Aug 03, 2023, 11:03 PM UTC

    All issues have been resolved as of 6:42pm EST.

  7. resolved Aug 04, 2023, 12:26 AM UTC

    This incident has been resolved.