Hi team, my

pants test

command has been running for 2700 seconds and no sign of stop. This happens after we upgrade python to 3.10, and I suspect it’s because some of the 174 requirements do not have wheels available for py310 and thus pants have to build from source. Is there any way to find out which 3rd party libraries are taking the longest time to build?

2698.31s Building requirements.pex with 174 requirements: Faker==8.12.1, ....

I have tried to inspect the currently running python processes but only see two processes

root@3d00a382d13e:/tmp/pants-sandbox-8Dyg2r# ps -ef | grep python
root       108    19  6 04:27 pts/0    00:02:56 /root/.cache/pants/setup/bootstrap-Linux-x86_64/2.13.0_py37/bin/python /root/.cache/pants/setup/bootstrap-Linux-x86_64/2.13.0_py37/bin/pants --pants-bin-name=./pants --pants-version=2.13.0 --no-pantsd --no-watch-filesystem --keep-sandboxes=always --level=debug --python-requirement-constraints=airflow2/src/python/airflow_dags/mlp/constraints_py310.txt test airflow2/test/python/mlp_dag_tests/test_data_deletion_configs.py
root       187   108  6 04:28 pts/0    00:03:02 /usr/local/bin/python3.10 /root/.cache/pants/named_caches/pex_root/unzipped_pexes/2aac9312154c299fac910874b778e800dca4c62a --tmpdir .tmp --jobs 8 --python-path /usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin --output-file requirements.pex --no-emit-warnings --manylinux manylinux2014 --python /usr/local/bin/python3.10 --sources-directory=source_files Faker==8.12.1 ...(omitted to avoid spam).... werkzeug==2.2.3 --no-pypi --index=<https://pypi.org/simple/> --index=<https://artifactory-pypi.cbhq.net/simple/> --resolver-version pip-2020-resolver --constraints __constraints.txt --layout packed

Not that it answers the question exactly but you should use a lockfile so that such issues will be caught before it shows up in your CI.

We do! The problem is some of the dependencies take a really long time to install, and we are having a hard time to find out which one (we have 500+ dependencies) because pants seems not printing information about the current package it’s trying to build.