I have also seen pantsd memory is too high and it increase if I make pantsd_max_memory_usage up. It's hard to set up property. I guess.

11:16:28.14 [INFO] handling request: `--python-repos-find-links=-['file:///home/runner/.cache/nce/c55ee58a557d20bd4b109870e5a01b264c0d501ce817cce29502b2552903834d/bindings/find_links/2.15.0/214abc14/index.html'] --version`
11:16:29.25 [INFO] request completed: `--python-repos-find-links=-['file:///home/runner/.cache/nce/c55ee58a557d20bd4b109870e5a01b264c0d501ce817cce29502b2552903834d/bindings/find_links/2.15.0/214abc14/index.html'] --version`
11:16:35.93 [INFO] handling request: `--python-repos-find-links=-['file:///home/runner/.cache/nce/c55ee58a557d20bd4b109870e5a01b264c0d501ce817cce29502b2552903834d/bindings/find_links/2.15.0/214abc14/index.html'] check --changed-since=origin/main --changed-dependees=transitive`
11:16:53.05 [ERROR] The scheduler was invalidated: Exception('pantsd process 2012 was using 2132.70 MiB of memory (above the `--pantsd-max-memory-usage` limit of 2048.00 MiB).')
11:16:53.45 [ERROR] service failure for <pants.pantsd.service.scheduler_service.SchedulerService object at 0x7fc418102eb0>.
11:16:53.46 [INFO] Waiting for ongoing runs to complete before exiting...
11:17:49.13 [INFO] Extending leases
11:17:51.43 [INFO] Done extending leases
11:19:11.43 [INFO] Extending leases
11:19:13.71 [INFO] Done extending leases
11:19:40.93 [INFO] request completed: `--python-repos-find-links=-['file:///home/runner/.cache/nce/c55ee58a557d20bd4b109870e5a01b264c0d501ce817cce29502b2552903834d/bindings/find_links/2.15.0/214abc14/index.html'] check --changed-since=origin/main --changed-dependees=transitive`
11:19:40.94 [INFO] Server exiting with Ok(())
11:19:40.94 [INFO] Waiting for Sessions to complete before exiting...
11:19:40.94 [INFO] Waiting for shutdown of: ["scheduler_service_session", "store_gc_service_session", "pants_run_2023_07_21_11_16_36_28_92c0eef0ce7c4c56bcecd77a8134e273"]
11:19:40.94 [INFO] Shutdown completed: "scheduler_service_session"
11:19:40.94 [INFO] Shutdown completed: "store_gc_service_session"
11:19:40.94 [INFO] Shutdown completed: "pants_run_2023_07_21_11_16_36_28_92c0eef0ce7c4c56bcecd77a8134e273"
11:19:41.14 [INFO] Exiting pantsd
11:19:41.15 [WARN] File watcher exiting with: The watcher was shut down.

the default memory limit is 4 GiB

should I put more than 4 GiB in this case? @flat-zoo-31952

You can leave the default and see what results you get. Looks like you’ve set it to 2 GiB. If 4 is not enough you can raise it

Thatnks for support! @flat-zoo-31952