Advance Billing Webhook Degradation - Incorrect Timezone Format for Subset of Webhooks

Update timeline

1. resolved Aug 30, 2024, 07:18 PM UTC

   On August 30th, the Advanced Billing system encountered a small period of degradation for a subset of webhooks that resulted in a temporary formatting change in webhook payloads that could have caused webhooks to fail parsing. The change was temporary, where the specific data changed was timezone format, for example, the format "Fri, 30 Aug 2024 11:03:04.000000000 EDT -04:00", changed to "2024-08-30T14:03:22Z". This change was quickly reverted, and we have proactively corrected formatting within impacted webhooks in order to allow webhooks that may have failed with the incorrect format to be replayed. No action is necessary unless you wish to re-send these events due to parsing errors occurring within your server. If your endpoints parse time and date for a specific format, then impacted webhooks may have initially failed with a 500 error. The now corrected webhooks are accessible via the Advance billing UI and may be replayed on your site if needed by: - Navigating to your site’s webhooks panel via Tools → Webhooks - Locate the missed event and select the box toggle associated with it - Select the “Resend Selected Webhooks” option to bulk resend selected webhook events These webhook events may be bulk resent via the API as outlined within our developer documentation below: https://developers.maxio.com/http/advanced-billing-api/api-endpoints/webhooks/replay-webhooks We recommend checking all webhook connections under Config→ Settings → Webhooks to ensure all endpoints are unpaused with the correct expected events selected. Additionally, we advise reviewing events for your site to see if any might have failed to properly replay the corresponding webhook or retrieve the data via API. We sincerely apologize for this inconvenience, and any disruption to your applications. Should you have any questions or concerns, please contact our Support Team for assistance.