Bitly experienced a major incident on September 16, 2024 affecting Bitly Pages, lasting 28m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 16, 2024, 08:51 PM UTC
Hi community. We are aware of a service outage specifically impacting our Link In Bio product and are currently investigating a fix.
- monitoring Sep 16, 2024, 09:13 PM UTC
A fix has been identified and we are monitoring the results.
- resolved Sep 16, 2024, 09:19 PM UTC
The validation of the fix has completed. Bitly Pages are fully operational again.
- postmortem Sep 26, 2024, 06:26 PM UTC
On `2024-09-16` We experienced an outage affecting the Bitly Pages product from `19:03Z` to `21:11Z`. The root cause was an added dependency which impacted client-side rendering of Pages. This issue was not immediately detected by automated tests or monitors. From `20:27Z` to `21:11Z`, our oncall team activated a recovery system allowing Pages served on the `bit.ly` domain to recover. Some custom domains continued to see impact. The code change contributing to the outage was identified and rolled back allowing for full recovery of Page rendering. We have already taken steps in our automation to detect similar rendering problems before they can affect our customers. We apologize for the inconvenience this outage may have caused and understand the impact to our customers. We place a high value on the reliability of our services and are evaluating ways to improve our ability to mitigate this type of issue. We also understand the impact and potential confusion caused by the lack of messaging during this outage. We value highly and will work to improve our ability to communicate about incidents in a timely fashion.