Hi guys, just started looking into pants, and got some things setup, looks very promising so far. I am seeing that pants hangs once in a while on simple commands, like:

 pants --print-stacktrace -ldebug generate-lockfiles
13:47:27.04 [DEBUG] acquiring lock: <pants.pantsd.lock.OwnerPrintingInterProcessFileLock object at 0x105589ca0>
13:47:27.04 [DEBUG] terminating pantsd
13:47:27.04 [DEBUG] sending signal 15 to pid 15791
13:47:27.25 [DEBUG] successfully terminated pid 15791
13:47:27.25 [DEBUG] purging metadata directory: /Users/pauliusasvydis/dev/monoceros/hermes/.pids/839d77331d83/pantsd
13:47:27.25 [DEBUG] Launching pantsd
13:47:27.25 [DEBUG] purging metadata directory: /Users/pauliusasvydis/dev/monoceros/hermes/.pids/839d77331d83/pantsd
13:47:27.26 [DEBUG] pantsd command is: PANTS_DAEMON_ENTRYPOINT=pants.pantsd.pants_daemon:launch_new_pantsd_instance PYTHONPATH=/Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/bin:/Users/pauliusasvydis/Library/Caches/nce/c1de1d854717a6245f45262ef1bb17b09e2c587590e7e3f406593c143ff875bd/cpython-3.9.16+20230507-aarch64-apple-darwin-install_only.tar.gz/python/lib/python39.zip:/Users/pauliusasvydis/Library/Caches/nce/c1de1d854717a6245f45262ef1bb17b09e2c587590e7e3f406593c143ff875bd/cpython-3.9.16+20230507-aarch64-apple-darwin-install_only.tar.gz/python/lib/python3.9:/Users/pauliusasvydis/Library/Caches/nce/c1de1d854717a6245f45262ef1bb17b09e2c587590e7e3f406593c143ff875bd/cpython-3.9.16+20230507-aarch64-apple-darwin-install_only.tar.gz/python/lib/python3.9/lib-dynload:/Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/lib/python3.9/site-packages /Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/bin/python /Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/bin/pants --python-repos-find-links=-['file:///Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/find_links/2.16.0/016d98d7/index.html'] --print-stacktrace -ldebug generate-lockfiles
13:47:31.97 [DEBUG] pantsd is running at pid 17159, pailgun port is 53855
13:47:31.97 [DEBUG] releasing lock: <pants.pantsd.lock.OwnerPrintingInterProcessFileLock object at 0x105589ca0>
13:47:31.97 [DEBUG] Connecting to pantsd on port 53855
13:47:31.97 [DEBUG] Connecting to pantsd on port 53855 attempt 1/3
13:47:31.98 [DEBUG] Connected to pantsd
13:47:31.98 [DEBUG] Launching 1 roots (poll=false).
13:47:31.99 [DEBUG] computed 1 nodes in 0.008771 seconds. there are 9 total nodes.
13:47:31.99 [DEBUG] Launching 1 roots (poll=false).
13:47:31.99 [DEBUG] computed 1 nodes in 0.000278 seconds. there are 13 total nodes.
13:47:32.14 [INFO] Initializing scheduler...
13:47:32.15 [DEBUG] File handle limit is: 10000
13:47:32.17 [DEBUG] Using [cache::CommandRunner { inner: bounded::CommandRunner { inner: SwitchedCommandRunner { .. }, .. }, .. }, cache::CommandRunner { inner: bounded::CommandRunner { inner: SwitchedCommandRunner { .. }, .. }, .. }] for process execution.
13:47:36.65 [DEBUG] Changes to /Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/bin, outside of the buildroot, will not be invalidated.
13:47:36.65 [DEBUG] Changes to /Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/bin, outside of the buildroot, will not be invalidated.
13:47:36.65 [DEBUG] Changes to /Users/pauliusasvydis/Library/Caches/nce/c1de1d854717a6245f45262ef1bb17b09e2c587590e7e3f406593c143ff875bd/cpython-3.9.16+20230507-aarch64-apple-darwin-install_only.tar.gz/python/lib/python39.zip, outside of the buildroot, will not be invalidated.
13:47:36.65 [DEBUG] Changes to /Users/pauliusasvydis/Library/Caches/nce/c1de1d854717a6245f45262ef1bb17b09e2c587590e7e3f406593c143ff875bd/cpython-3.9.16+20230507-aarch64-apple-darwin-install_only.tar.gz/python/lib/python3.9, outside of the buildroot, will not be invalidated.
13:47:36.65 [DEBUG] Changes to /Users/pauliusasvydis/Library/Caches/nce/c1de1d854717a6245f45262ef1bb17b09e2c587590e7e3f406593c143ff875bd/cpython-3.9.16+20230507-aarch64-apple-darwin-install_only.tar.gz/python/lib/python3.9/lib-dynload, outside of the buildroot, will not be invalidated.
13:47:36.65 [DEBUG] Changes to /Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/lib/python3.9/site-packages, outside of the buildroot, will not be invalidated.
13:47:36.65 [DEBUG] setting up service <pants.pantsd.service.scheduler_service.SchedulerService object at 0x113c4d670>
13:47:36.65 [DEBUG] setting up service <pants.pantsd.service.store_gc_service.StoreGCService object at 0x113c6b8b0>
13:47:36.65 [DEBUG] starting service <pants.pantsd.service.scheduler_service.SchedulerService object at 0x113c4d670>
13:47:36.65 [DEBUG] starting service <pants.pantsd.service.store_gc_service.StoreGCService object at 0x113c6b8b0>
13:47:36.65 [INFO] Scheduler initialized.
13:47:36.65 [DEBUG] Launching 1 roots (poll=false).
13:47:36.65 [DEBUG] computed 1 nodes in 0.000264 seconds. there are 13 total nodes.
13:47:36.65 [DEBUG] Launching 1 roots (poll=false).
13:47:36.65 [DEBUG] computed 1 nodes in 0.000062 seconds. there are 13 total nodes.
13:47:36.67 [WARN] DEPRECATED: option 'extra_type_stubs' in scope 'mypy' is scheduled to be removed in version 2.18.0dev0.

Extra type stubs are now installed from a named resolve, as described at <https://www.pantsbuild.org/v2.16/docs/python-lockfiles>.
13:47:36.68 [DEBUG] specs are: Specs(includes=RawSpecs(description_of_origin='CLI arguments', address_literals=(), file_literals=(), file_globs=(), dir_literals=(), dir_globs=(), recursive_globs=(), ancestor_globs=(), unmatched_glob_behavior=<GlobMatchErrorBehavior.error: 'error'>, filter_by_global_options=True, from_change_detection=False), ignores=RawSpecs(description_of_origin='CLI arguments', address_literals=(), file_literals=(), file_globs=(), dir_literals=(), dir_globs=(), recursive_globs=(), ancestor_globs=(), unmatched_glob_behavior=<GlobMatchErrorBehavior.error: 'error'>, filter_by_global_options=False, from_change_detection=False))
13:47:36.68 [DEBUG] changed_options are: ChangedOptions(since=None, diffspec=None, dependents=<DependentsOption.NONE: 'none'>)
13:47:36.68 [DEBUG] Launching 1 roots (poll=false).
13:47:36.69 [DEBUG] computed 1 nodes in 0.009641 seconds. there are 13 total nodes.
13:47:36.69 [DEBUG] Launching 1 roots (poll=false).
13:47:36.69 [DEBUG] computed 1 nodes in 0.000922 seconds. there are 21 total nodes.
13:47:36.69 [DEBUG] Launching 1 roots (poll=false).
13:47:36.69 [DEBUG] computed 1 nodes in 0.000189 seconds. there are 21 total nodes.
13:47:36.69 [DEBUG] requesting <class 'pants.core.goals.generate_lockfiles.GenerateLockfilesGoal'> to satisfy execution of `generate-lockfiles` goal
13:47:36.69 [DEBUG] Launching 1 roots (poll=false).
13:47:36.70 [DEBUG] Completed: Generate `python_requirement` targets from Poetry pyproject.toml
13:47:36.70 [DEBUG] Completed: Find all targets in the project
13:47:36.71 [DEBUG] Completed: Determine all Python interpreter versions used by Pytest in your project (for lockfile generation)
13:47:36.71 [DEBUG] Completed: Set up lockfile request for [mypy].extra_type_stubs
13:47:36.71 [DEBUG] Completed: Determine Black interpreter constraints (for lockfile generation)
13:47:36.71 [DEBUG] Completed: Determine all Python interpreter versions used by setuptools in your project (for lockfile generation)
13:47:36.71 [DEBUG] Completed: Determine all Python interpreter versions used by iPython in your project (for lockfile generation)
13:47:36.71 [DEBUG] Completed: Resolve transitive targets
13:47:36.71 [DEBUG] Completed: pants.backend.python.util_rules.python_sources.prepare_python_sources
13:47:36.71 [DEBUG] Completed: pants.backend.python.typecheck.mypy.subsystem.mypy_first_party_plugins
13:47:36.71 [DEBUG] Completed: Determine MyPy interpreter constraints (for lockfile generation)
13:47:36.71 [DEBUG] Completed: pants.backend.python.util_rules.python_sources.strip_python_sources
13:47:36.71 [DEBUG] Completed: pants.backend.python.lint.flake8.subsystem.flake8_first_party_plugins
13:47:36.71 [DEBUG] Completed: Determine all Python interpreter versions used by Flake8 in your project (for lockfile generation)
13:47:36.71 [DEBUG] Completed: Extracting an archive file
13:47:36.71 [DEBUG] Completed: pants.core.util_rules.external_tool.download_external_tool
13:47:36.71 [DEBUG] Completed: Prepare environment for running PEXes
13:47:36.71 [DEBUG] Completed: acquire_command_runner_slot
13:47:36.71 [DEBUG] Running Generate lockfile for python-default under semaphore with concurrency id: 1, and concurrency: 1
13:47:36.72 [DEBUG] Completed: setup_sandbox
13:47:36.72 [DEBUG] spawned local process as Some(17185) for Process { argv: ["/Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/bin/python", "./pex", "lock", "create", "--tmpdir", ".tmp", "--python-path", "/Users/pauliusasvydis/.pyenv/versions/3.10.12/bin:/Users/pauliusasvydis/.pyenv/versions/3.10.9/bin:/Users/pauliusasvydis/.pyenv/versions/3.11.4/bin:/Users/pauliusasvydis/.pyenv/versions/3.9.17/bin", "--output=lock.json", "--no-emit-warnings", "--style=universal", "--pip-version", "20.3.4-patched", "--resolver-version", "pip-2020-resolver", "--target-system", "linux", "--target-system", "mac", "--indent=2", "--no-pypi", "--index=<https://pypi.org/simple/>", "--manylinux", "manylinux2014", "--interpreter-constraint", "CPython==3.10.*", "black<24.0.0,>=23.7.0", "mypy<2.0.0,>=1.4.1"], env: {"CPPFLAGS": "", "LANG": "en_US.UTF-8", "LDFLAGS": "", "PATH": "/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/Users/pauliusasvydis/.cargo/bin", "PEX_IGNORE_RCFILES": "true", "PEX_PYTHON": "/Users/pauliusasvydis/Library/Caches/nce/c75e6f54c031ca755a5f693d7d6f558fdd6c194598741388cf87aea4895f78ec/bindings/venvs/2.16.0/bin/python", "PEX_ROOT": ".cache/pex_root", "PEX_SCRIPT": "pex3"}, working_directory: None, input_digests: InputDigests { complete: DirectoryDigest { digest: Digest { hash: Fingerprint<bdb5690b221578e63c3bfc6ab8fa2bcdf7ed0613c69bd1971241243a231079e0>, size_bytes: 254 }, tree: "Some(..)" }, nailgun: DirectoryDigest { digest: Digest { hash: Fingerprint<e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855>, size_bytes: 0 }, tree: "Some(..)" }, input_files: DirectoryDigest { digest: Digest { hash: Fingerprint<0452d4b7e682d014f1385c692c97eca39a8bdf20668cc176b4c31d21311f1333>, size_bytes: 158 }, tree: "Some(..)" }, immutable_inputs: {RelativePath(".python-build-standalone"): DirectoryDigest { digest: Digest { hash: Fingerprint<e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855>, size_bytes: 0 }, tree: "Some(..)" }}, use_nailgun: {} }, output_files: {RelativePath("lock.json")}, output_directories: {}, timeout: None, execution_slot_variable: None, concurrency_available: 0, description: "Generate lockfile for python-default", level: Info, append_only_caches: {CacheName("pex_root"): RelativePath(".cache/pex_root")}, jdk_home: None, cache_scope: PerSession, execution_environment: ProcessExecutionEnvironment { name: None, platform: Macos_arm64, strategy: Local }, remote_cache_speculation_delay: 0ns }
⠈ 190.70s Generate lockfile for python-default

Note the long running time

We have lockfile generation that runs into the thousands of seconds.

interesting, I just started out with it and normally it runs for <10s

Hmm, this is slippery

been using it now for a few days and have not encountered it again

Well that's good. Let us know if it returns!