FieldEdge incident

Login Error

Major Resolved View vendor source →

FieldEdge experienced a major incident on September 22, 2023 affecting Site East and Mobile and 1 more component, lasting 2d 20h. The incident has been resolved; the full update timeline is below.

Started
Sep 22, 2023, 02:45 PM UTC
Resolved
Sep 25, 2023, 11:43 AM UTC
Duration
2d 20h
Detected by Pingoru
Sep 22, 2023, 02:45 PM UTC

Affected components

Site EastMobileSite West

Update timeline

  1. identified Sep 22, 2023, 12:25 PM UTC

    We have discovered an issue connecting to some Microsoft services which is impacting the ability to login for some of our users. We have engaged Microsoft support and are working diligently to restore services as quickly as possible.

  2. identified Sep 22, 2023, 01:43 PM UTC

    Our engineering team is diligently working on a resolution for our impacted members.

  3. identified Sep 22, 2023, 02:45 PM UTC

    Our Engineering team has implemented a temporary read-only workaround for the application this workaround should be implemented within the next hour. However, some of our members may receive access sooner. This means that while you can log in and view information, you cannot make any changes. We are still working towards restoring full functionality to our affected members.

  4. identified Sep 22, 2023, 04:02 PM UTC

    We have successfully rolled out the read-only change. Our engineering team is still working with Microsoft support to get a resolution as soon as possible. We currently don't have an ETA on when a resolution will be available.

  5. identified Sep 22, 2023, 05:08 PM UTC

    Our engineering team is still working with Microsoft support to get a resolution as soon as possible.

  6. identified Sep 22, 2023, 06:30 PM UTC

    Our engineering team is still working with Microsoft support to get a resolution as soon as possible.

  7. identified Sep 22, 2023, 09:32 PM UTC

    Our engineering team is still working with Microsoft support to get a resolution as soon as possible.

  8. identified Sep 23, 2023, 12:23 PM UTC

    Our engineering team is still diligently working with Microsoft to resolve this issue

  9. monitoring Sep 24, 2023, 01:50 AM UTC

    We have resolved the issue with connecting to Microsoft services and are in the process of returning members that had read-only access to full access.

  10. identified Sep 24, 2023, 10:52 PM UTC

    Our Engineering team has implemented a temporary read-only workaround for the application as Microsoft continues to work on mitigating the issue with the affected members.

  11. resolved Sep 25, 2023, 11:43 AM UTC

    Microsoft has mitigated the issue with some of our member databases and all members have restored full access.