Placements Outage History

There is a global outage to our DNS provider and it is impacting the ability for PIO users to access the platform. The detailed status of this incident is here: https://www.cloudflarestatus.com/ We will monitor the status of the resolution with Cloudflare.

Upstream issues with AWS are affecting Placements.io operations. We are seeing intermittent issues, especially with write operations. AWS incident status is available here: https://health.aws.amazon.com/health/status

An ongoing incident with an infrastructure provider is causing degraded services on the platform. Specifically, we are unable to initiate scheduled jobs or spin up new machines to process queues. The app generally functions fine but scheduled ad server and CRM imports are paused and scheduled billing jobs can't be run. We are monitoring the incident with our infrastructure provider.

We are continuing to investigate this issue.

Our third party service provider continues to investigate and remediate the issue. Billing reports and hour imports, along with other backend jobs (like email notifications) continue to be backed up.

We received the following update from our infrastructure provider: "We continue to work on the permanent fix and explore alternate paths to resolution. Once the fix is developed, an estimated time to resolution will be shared."

We have received the following update from our infrastructure provider: "We’ve identified the likely trigger of the issue and are making strong progress toward a resolution. A recent automated update disrupted network connectivity on affected instances. We're working on a fix to prevent this from recurring and will provide an ETA for resolution when it's available."

We have recovered some ability to scale up workers manually and are now able to process billing reports. CRM imports are now processing faster as well after scaling up workers.