PagerTree experienced a minor incident on July 30, 2023, lasting 1001d 22h. The incident has been resolved; the full update timeline is below.
Update timeline
- monitoring Jul 30, 2023, 12:31 AM UTC
2023-07-31 18:28:41 UTC Operational [ Resolved ] We have published a postmortem here: https://pagertree.com/blog/fly.io-migrate-to-v2-postgres-stuck-in-read-only-mode 2023-07-30 01:43:02 UTC Operational [ Resolved ] Our database is up in a read/write state. All services are now fully functional. A postmortem will be written on Monday, summarizing the issue, root cause, and remediation. Thank you for your patience and understanding. 2023-07-30 01:16:46 UTC Operational [ Monitoring ] Our database is back up in a read/write state. We are monitoring at the moment. Thank you for your patience. 2023-07-30 00:59:57 UTC Partial outage [ Identified ] Still working on the database read only issue. We will post another update in 30 minutes 2023-07-30 00:35:27 UTC Partial outage [ Identified ] Inserts in the database will be blocked for approximately 10 minutes. Incoming requests will fail. Read requests will succeed. 2023-07-30 00:31:03 UTC Problem detected [ Identified ] We are currently working through a database upgrade.