Data443 incident

Postgresql cluster for DHCP is read-only

Notice Resolved View vendor source →

Data443 experienced a notice incident on April 28, 2026, lasting 2h 29m. The incident has been resolved; the full update timeline is below.

Started
Apr 28, 2026, 06:50 PM UTC
Resolved
Apr 28, 2026, 09:20 PM UTC
Duration
2h 29m
Detected by Pingoru
Apr 28, 2026, 06:50 PM UTC

Update timeline

  1. investigating Apr 28, 2026, 06:50 PM UTC

    The database replicas have desync due time drift. Shared NTP server is functioning correctly, the team is investigating further, while the database replicas resync.

  2. investigating Apr 28, 2026, 07:05 PM UTC

    The databases are resynced. We are still investigating the NTP issue.

  3. investigating Apr 28, 2026, 07:48 PM UTC

    The resynced replicas left the data in an unresolvable state to the application. We are rolling back to an earlier backup.

  4. monitoring Apr 28, 2026, 07:55 PM UTC

    DHCP is again fully operational. We are monitoring the DHCP reservations roll out.

  5. monitoring Apr 28, 2026, 09:10 PM UTC

    Services are mostly recovered. We're monitoring the last of the HAPairs come up.

  6. resolved Apr 28, 2026, 09:20 PM UTC

    The incident has been resolved.