average-australia-85137
03/05/2021, 3:00 PM(remit) [nate@ragin-cajun remit-srv]$ time ./pants test --force tests
Scrubbed PYTHONPATH=/home/nate/wave/remit-srv/src: from the environment.
09:56:24.43 [INFO] Completed: test - tests/test_terrapay.py succeeded.
ā tests/test_terrapay.py succeeded.
real 2m23.628s
user 0m0.429s
sys 0m0.042s
compared with:
(remit) [nate@ragin-cajun remit-srv]$ time pytest tests/test_terrapay.py
============================================== test session starts ==============================================
platform linux -- Python 3.8.5, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /home/nate/wave/remit-srv
plugins: celery-4.4.7, requests-mock-1.8.0, Faker-4.1.1, cov-2.10.1
collected 596 items
tests/test_terrapay.py .................................................................................. [ 13%]
......................................................................................................... [ 31%]
......................................................................................................... [ 48%]
......................................................................................................... [ 66%]
......................................................................................................... [ 84%]
.............................................................................................. [100%]
======================================== 596 passed in 67.94s (0:01:07) =========================================
real 1m13.382s
user 0m59.747s
sys 0m2.068s
(remit) [nate@ragin-cajun remit-srv]$ time ./pants test --force tests
Scrubbed PYTHONPATH=/home/nate/wave/remit-srv/src: from the environment.
10:06:27.88 [INFO] Completed: test - tests/test_aml_actions.py succeeded.
ā tests/test_aml_actions.py succeeded.
real 0m13.151s
user 0m0.446s
sys 0m0.041s
(remit) [nate@ragin-cajun remit-srv]$ time pytest tests/test_aml_actions.py
============================================== test session starts ==============================================
platform linux -- Python 3.8.5, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /home/nate/wave/remit-srv
plugins: celery-4.4.7, requests-mock-1.8.0, Faker-4.1.1, cov-2.10.1
collected 37 items
tests/test_aml_actions.py ..................................... [100%]
============================================== 37 passed in 1.50s ===============================================
real 0m6.756s
user 0m5.098s
sys 0m1.233s
hundreds-father-404
03/05/2021, 3:14 PMaverage-australia-85137
03/05/2021, 3:18 PMProcessExecutionFailure: Process 'Building pytest_runner.pex' failed with exit code 1.
stdout:
stderr:
Traceback (most recent call last):
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.bootstrap/pex/pex.py", line 477, in execute
exit_value = self._wrap_coverage(self._wrap_profiling, self._execute)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.bootstrap/pex/pex.py", line 394, in _wrap_coverage
return runner(*args)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.bootstrap/pex/pex.py", line 425, in _wrap_profiling
return runner(*args)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.bootstrap/pex/pex.py", line 533, in _execute
return self.execute_entry(self._pex_info.entry_point)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.bootstrap/pex/pex.py", line 650, in execute_entry
return runner(entry_point)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.bootstrap/pex/pex.py", line 668, in execute_pkg_resources
return runner()
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/bin/pex.py", line 1097, in main
execute_cached_args = seed_cache(options, pex)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/bin/pex.py", line 1139, in seed_cache
venv_pex = ensure_venv(pex)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/pex_bootstrapper.py", line 421, in ensure_venv
shenbang = populate_venv_with_pex(
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/tools/commands/venv.py", line 114, in populate_venv_with_pex
for dist in pex.activate():
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/pex.py", line 132, in activate
self._activated_dists = self._activate()
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/pex.py", line 119, in _activate
activated_dists.extend(env.activate())
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/environment.py", line 365, in activate
self._activated_dists = self._activate()
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/environment.py", line 689, in _activate
resolved = self.resolve(all_reqs)
File "/home/nate/.cache/pants/named_caches/pex_root/unzipped_pexes/ba3fdfe2d776ac7517a031da663a86b1b88caef1/.deps/pex-2.1.32-py2.py3-none-any.whl/pex/environment.py", line 596, in resolve
raise ResolveError(
pex.environment.ResolveError: Failed to resolve requirements from PEX environment @ /tmp/process-executionzVTk6f/requirements.pex.
Needed manylinux_2_33_x86_64-cp-38-cp38 compatible dependencies for:
1: python>=2.6.0
Required by:
et-xmlfile 1.0.1
But this pex had no 'python' distributions.
hundreds-father-404
03/05/2021, 3:23 PMaverage-australia-85137
03/05/2021, 3:25 PMLinux version 5.11.2-arch1-1 (linux@archlinux) (gcc (GCC) 10.2.0, GNU ld (GNU Binutils) 2.36.1) #1 SMP PREEMPT Fri, 26 Feb 2021 18:26:41 +0000
[nate@ragin-cajun remit-srv]$ ./pants package src:remit-dist
10:36:41.11 [INFO] Completed: Building setuptools.pex with 2 requirements: setuptools>=50.3.0,<54.0, wheel>=0.35.1,<0.37
10:36:44.34 [INFO] Wrote dist/remit-srv-0.tar.gz
10:36:44.34 [INFO] Wrote dist/remit_srv-0-py3-none-any.whl
enough-analyst-54434
03/05/2021, 3:48 PMaverage-australia-85137
03/05/2021, 4:23 PMhundreds-father-404
03/05/2021, 4:29 PMenough-analyst-54434
03/05/2021, 4:29 PMaverage-australia-85137
03/05/2021, 4:31 PMbusy-vase-39202
03/05/2021, 5:53 PMhundreds-father-404
03/05/2021, 5:57 PMIs this something to mention in Pants docs?We call attention to MyPy running slowly, which is particularly egregious due to not using MyPy's cache https://www.pantsbuild.org/docs/python-typecheck-goal#performance-may-be-slower-than-normal But generally,, I don't think the perf issues are egregious enough (on Pants 2.3+) to need to call attention to it, unless more users report it's still concerning enough we need to address it. And we're planning work on addressing #1 and #3 from https://pantsbuild.slack.com/archives/C046T6T9U/p1614962378139800?thread_ts=1614956429.132400&cid=C046T6T9U
in rare circumstances an external package may cause Pants to run slowlyThat external dep isn't causing Pants to run slowly, it's causing things to fail to build
average-australia-85137
03/05/2021, 6:34 PMenough-analyst-54434
03/05/2021, 8:39 PMRequires
metadata associated with et-xml's requires
setuptools arg. That seems completely broken, but I want to confirm this with an experiment. If true, I'll have Pex follow their lead and ignore it too, which would "solve" this.helpful-lunch-92084
03/05/2021, 8:52 PMaverage-australia-85137
03/05/2021, 8:57 PMenough-analyst-54434
03/05/2021, 9:19 PM