Hi all! I have troubles understanding why dependen...
# general
a
Hi all! I have troubles understanding why dependency resolution and build in my CI (githib actions) takes so long (11+ mins) Example: • from 094707.86 [INFO] to 095201.55, i see records like: Completed: Building 3 requirements for requirements.pex from the third_party/pip_requirements.lock resolve: pydantic==2.9.2, pytest==7.4.0, shortuuid==1.0.11. This is printed for all dependencies in pip-requirements. • from 095205.97 [INFO] to 095842.00, alternating records: ◦ Starting: Building pytest_runner.pex ◦ Completed: Building pytest_runner.pex Then tests start actually running. I install pants with the following action:
Copy code
- uses: pantsbuild/actions/init-pants@v8
          with:
            gha-cache-key: v0
            named-caches-hash:
              ${{ hashFiles('third_party/pip_requirements.lock') }}
            cache-lmdb-store: "false" # defaults to 'false'
Any suggestions how to improve the situation would be appreciated.
e
I'm a bit new to this, so I'll defer to rest of the channel for more info, but one thing that stood out is that your "Starting: <whatever>" and "Completed: <whatever>" are alternating (as opposed to 4-5 starting messages followed by a bunch of completed messages). I think that might suggest that your CI runner is only giving you one core to work with. (ie. only one process running at once). If you lose out on parallelism, some things will definitely be slow.
a
Thanks @elegant-florist-94385! We are actually using default Githib runners that provide 2 CPU 7 GB RAM. If it was the parallelizm problem I would expect to see something like: Starting: Building pytest_runner.pex Completed: Building pytest_runner.pex
Copy code
Completed: Run Pytest - <test-name>- succeeded.
Starting: Building pytest_runner.pex Completed: Building pytest_runner.pex
Copy code
Completed: Run Pytest - <test-name-other>- succeeded.
When in my case it is just outputting Starting: Building pytest_runner.pex Completed: Building pytest_runner.pex for about 5 mins And then a bunch of 'Completed: Run Pytest' Messages. Illustration: