Amperity incident

Errors orchestrating to Facebook destinations

Minor Resolved View vendor source →

Amperity experienced a minor incident on October 26, 2023 affecting AWS Platform and Azure Platform and 1 more component, lasting 1d 11h. The incident has been resolved; the full update timeline is below.

Started
Oct 26, 2023, 08:43 PM UTC
Resolved
Oct 28, 2023, 08:12 AM UTC
Duration
1d 11h
Detected by Pingoru
Oct 26, 2023, 08:43 PM UTC

Affected components

AWS PlatformAzure PlatformDestinations

Update timeline

  1. investigating Oct 26, 2023, 08:43 PM UTC

    Our Platform Engineering team has identified an increase in errors while orchestrating to Facebook for both destinations and campaigns. Failed orchestrations may be retried but may still fail. Amperity has reached out to Meta Developer Support, and we are awaiting additional guidance or root cause.

  2. investigating Oct 26, 2023, 11:35 PM UTC

    The Amperity Platform Engineering team is continuing to observe additional failures; we are waiting on guidance from Meta. We will post additional updates as we learn more.

  3. investigating Oct 27, 2023, 02:22 AM UTC

    The Amperity Platform Engineering team continues to wait on guidance from Meta. We will post additional updates as we learn more.

  4. investigating Oct 27, 2023, 05:08 AM UTC

    The Amperity Platform Engineering team continues to monitor the situation as we wait on guidance from Meta. We will post additional updates as we learn more.

  5. investigating Oct 27, 2023, 07:34 AM UTC

    The Amperity Platform Engineering team continues to wait on guidance from Meta. We will post additional updates as we learn more.

  6. investigating Oct 27, 2023, 01:04 PM UTC

    The team continues to monitor the ongoing situation. We will post additional updates as we learn more.

  7. investigating Oct 27, 2023, 04:31 PM UTC

    The Amperity Platform Engineering team continues to monitor the situation and has sought additional guidance from Meta. We will post updates as we learn more.

  8. monitoring Oct 27, 2023, 11:28 PM UTC

    After prompts from Amperity's Platform Engineering Team, Meta has identified a root cause for the observed orchestration errors. We will continue to monitor the situation and provide updates accordingly.

  9. resolved Oct 28, 2023, 08:12 AM UTC

    After a fix executed by Meta, impact on Amperity has been mitigated. We are declaring this resolved.