TicketNetwork incident

Sandbox Outage - Multiple Components

Minor Resolved View vendor source →

TicketNetwork experienced a minor incident on July 25, 2023, lasting 16d 4h. The incident has been resolved; the full update timeline is below.

Started
Jul 25, 2023, 01:21 PM UTC
Resolved
Aug 10, 2023, 06:14 PM UTC
Duration
16d 4h
Detected by Pingoru
Jul 25, 2023, 01:21 PM UTC

Update timeline

  1. identified Jul 25, 2023, 01:21 PM UTC

    Please be advised that we are currently experiencing an outage for many of our components in the Sandbox environment. We have identified the issue and are working on a fix. For further details, check the status of this incident via status.ticketnetwork.com while we investigate the issue and work towards a fix. This issue does not effect the Production environment, only Sandbox. If you believe you received this email in error or would like to change which components you wish to be alerted on, please use the link provided in the footer of this email. Thank you.

  2. identified Jul 25, 2023, 03:40 PM UTC

    A server which houses many of our sandbox components has experienced a failure. Our teams are working hard to restore this server and will aim to have it working by end of day today. However, there are still some unknowns. We will provide updates on the timeline as soon as we are able.

  3. identified Jul 25, 2023, 08:35 PM UTC

    The team is in the process of rebuilding our main sandbox server. This process is going to take longer than we initially anticipated. We appreciate your continued patience and will continue to provide updates as they become available.

  4. identified Jul 26, 2023, 01:21 PM UTC

    The team made significant progress overnight in restoring the server and will continue to work through issues to bring each component back online. As always, we thank you for your patience and will provide updates as things progress.

  5. identified Jul 27, 2023, 05:45 PM UTC

    The majority of components are now operational with just a few exceptions that the team is still working through. Again, thank you for your patience. We will continue to provide updates as they become available.

  6. monitoring Aug 04, 2023, 08:19 PM UTC

    The Sandbox server is now operational. We believe all critical workflows and main components are working. Please reach out to our support teams to report any problems or concerns. Thank you for your continued patience

  7. resolved Aug 10, 2023, 06:14 PM UTC

    This incident has been resolved.