GoodTime incident

Greenhouse sync issues

Minor Resolved View vendor source →

GoodTime experienced a minor incident on September 14, 2023 affecting Greenhouse, lasting 3d 21h. The incident has been resolved; the full update timeline is below.

Started
Sep 14, 2023, 11:20 PM UTC
Resolved
Sep 18, 2023, 08:31 PM UTC
Duration
3d 21h
Detected by Pingoru
Sep 14, 2023, 11:20 PM UTC

Affected components

Greenhouse

Update timeline

  1. investigating Sep 14, 2023, 12:59 PM UTC

    Greenhouse customers are currently experiencing slow response times and difficulties opening candidates in Goodtime from the Greenhouse site.

  2. investigating Sep 14, 2023, 01:03 PM UTC

    We are continuing to investigate this issue.

  3. identified Sep 14, 2023, 02:31 PM UTC

    Greenhouse customers are experiencing slow response times due to issues with the Greenhouse API. The issue is caused by Greenhouse ATS maintenance and we are monitoring their progress.

  4. identified Sep 14, 2023, 11:20 PM UTC

    Goodtime has deployed a fix to improve the slow performance. However, some lag in the integration with Greenhouse persists

  5. identified Sep 15, 2023, 12:26 AM UTC

    We are continuing to work on a fix for this issue.

  6. identified Sep 15, 2023, 02:26 PM UTC

    We are still working on fixing latency issues in our platform affecting customers who have a GoodTime integration with Greenhouse. This is currently our highest priority. Thank you for your patience!

  7. identified Sep 15, 2023, 10:30 PM UTC

    We are continuing to work on a fix for this issue.

  8. identified Sep 16, 2023, 07:23 PM UTC

    We have narrowed the issue down and will deploy a fix as soon as we have identified it

  9. identified Sep 18, 2023, 06:07 AM UTC

    Our present investigations and ongoing optimization have uncovered inconsistencies in Greenhouse rate limit policies that may be prematurely bottlenecking requests. These inconsistencies appear to be the root cause of performance issues for Greenhouse customers users on GoodTime. We're actively working with Greenhouse to resolve this issue.

  10. monitoring Sep 18, 2023, 02:23 PM UTC

    Goodtime is monitoring the results.

  11. resolved Sep 18, 2023, 08:31 PM UTC

    In partnership with Greenhouse, we identified the issue causing API communication slowdowns. Sync performance will gradually return to normal today.