PlayFab incident

Increased error rate for Authentication/ValidateToken

Major Resolved View vendor source →

PlayFab experienced a major incident on August 19, 2025 affecting Authentication, lasting 4h 14m. The incident has been resolved; the full update timeline is below.

Started
Aug 19, 2025, 04:30 PM UTC
Resolved
Aug 19, 2025, 08:44 PM UTC
Duration
4h 14m
Detected by Pingoru
Aug 19, 2025, 04:30 PM UTC

Affected components

Authentication

Update timeline

  1. identified Aug 19, 2025, 05:10 PM UTC

    We are investigating an increase in errors for Authentication/ValidateToken

  2. identified Aug 19, 2025, 05:10 PM UTC

    We are continuing to work on a fix for this issue.

  3. resolved Aug 19, 2025, 08:44 PM UTC

    This incident has been resolved.

  4. postmortem Aug 26, 2025, 08:35 PM UTC

    On August 19, 2025, between 9:32 AM and 10:50 AM PDT, some customers experienced failures when calling PlayFab APIs due to issues with entity token validation. The incident was caused by a switch in the JSON library used for serialization and deserialization of entity tokens \(for improved security and efficiency\). We resolved the issue by rolling back the serialization change and advising impacted customers to refresh their tokens. ### Impact During the incident, calls to validate entity tokens failed, preventing all further API calls using those tokens. Affected APIs primarily included WriteTelemetryEvents, Catalog search, GetPlayFabIdFrom\*Id, ExecuteCloudScript, and Group-related APIs. This resulted in service disruption for customers relying on these endpoints. ### Root Cause Analysis The root cause was a deployment that switched the JSON library responsible for entity token serialization. After rolling back the change, errors persisted for tokens minted during the incident window, requiring customers to refresh their tokens. ### Action Items To prevent similar incidents from happening again, we have taken the following actions: * Added documentation to the entity token release process to highlight serialization risks and warnings. * Implemented additional backcompat token tests for the entity token to expand test