FYI ~ASU~ issue when installing a lock file I unfortunately

Question

FYI ~ASU~ issue when installing a lock file I unfortunately do not have time to investigate this right now Does anyone else reproduce

hundreds-father-404 · Answer

``` pants test src python pants backend python util rules lockfile metadata test py```

hundreds-father-404 · Answer

```Engine traceback in select in pants core goals test run tests in pants backend python goals pytest runner run python test src python pants backend python util rules lockfile metadata test py tests in pants backend python goals pytest runner setup pytest for target in pants backend python util rules pex create pex in pants backend python util rules pex build pex requirements pex in pants engine process fallible to exec result or raise Traceback most recent call last File Users ericarellano code pants src python pants engine process py line 272 in fallible to exec result or raise raise ProcessExecutionFailure pants engine process ProcessExecutionFailure Process Building 11 requirements for requirements pex from the 3rdparty python user reqs lock resolve PyYAML lt 7 0 gt =6 0 ansicolors==1 1 8 packaging==21 3 pex==2 1 77 pytest lt 7 1 0 gt =6 2 4 setuptools lt 58 0 gt =56 0 0 toml==0 10 2 types PyYAML==6 0 3 types setuptools==57 4 7 types toml==0 10 3 typing extensions==4 0 1 failed with exit code 1 stdout stderr Traceback most recent call last File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex fetcher py line 79 in get body stream yield body stream File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex resolve lock resolver py line 67 in save for chunk in iter lambda stream read self BUFFER SIZE b File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex resolve lock resolver py line 67 in lt lambda gt for chunk in iter lambda stream read self BUFFER SIZE b File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 http client py line 463 in read n = self readinto b File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 http client py line 507 in readinto n = self fp readinto b File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 socket py line 704 in readinto return self sock recv into b File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 ssl py line 1241 in recv into return self read nbytes buffer File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 ssl py line 1099 in read return self sslobj read len buffer socket timeout The read operation timed out During handling of the above exception another exception occurred Traceback most recent call last File Users ericarellano cache pants named caches pex root unzipped pexes ee5e123a2c302f34cbb0831c696b2134df893f39 bootstrap pex pex py line 504 in execute exit value = self wrap coverage self wrap profiling self execute File Users ericarellano cache pants named caches pex root unzipped pexes ee5e123a2c302f34cbb0831c696b2134df893f39 bootstrap pex pex py line 409 in wrap coverage return runner args File Users ericarellano cache pants named caches pex root unzipped pexes ee5e123a2c302f34cbb0831c696b2134df893f39 bootstrap pex pex py line 440 in wrap profiling return runner args File Users ericarellano cache pants named caches pex root unzipped pexes ee5e123a2c302f34cbb0831c696b2134df893f39 bootstrap pex pex py line 560 in execute return self execute entry self pex info entry point File Users ericarellano cache pants named caches pex root unzipped pexes ee5e123a2c302f34cbb0831c696b2134df893f39 bootstrap pex pex py line 696 in execute entry return self execute pkg resources entry point File Users ericarellano cache pants named caches pex root unzipped pexes ee5e123a2c302f34cbb0831c696b2134df893f39 bootstrap pex pex py line 728 in execute pkg resources return runner File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex bin pex py line 739 in main do main File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex bin pex py line 760 in do main pex builder = build pex File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex bin pex py line 609 in build pex resolve from lock File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex resolve lock resolver py line 305 in resolve from lock pool map File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 multiprocessing pool py line 364 in map return self map async func iterable mapstar chunksize get File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 multiprocessing pool py line 771 in get raise self value File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 multiprocessing pool py line 125 in worker result = True func args kwds File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 multiprocessing pool py line 48 in mapstar return list map args File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex resolve lock resolver py line 163 in download artifact return catch File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex result py line 101 in catch return func args kwargs File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex resolve lockfile download manager py line 152 in store self save File Users ericarellano cache pants named caches pex root installed wheels 607cd8973e976e388537a962f1c47db79acb93c0c37055a6b47e4fa99c13442a pex 2 1 77 py2 py3 none any whl pex resolve lock resolver py line 69 in save digest update chunk File opt homebrew Cellar python 3 9 3 9 10 Frameworks Python framework Versions 3 9 lib python3 9 contextlib py line 169 in exit raise RuntimeError generator didn t stop after throw RuntimeError generator didn t stop after throw ```

hundreds-father-404 · Answer

pn this branch <https github com pantsbuild pants pull 15074> Was trying to reproduce the CI failure

enough-analyst-54434 · Answer

`socket timeout The read operation timed out` So retry in CI is fine I ll file a Pex issue to unmask the real error in these cases

hundreds-father-404 · Answer

hm in CI i see <https github com pantsbuild pants runs 5887288678 check suite focus=true step 14 129> ```15 05 49 82 ERROR Completed Run Pytest src python pants backend python util rules lockfile metadata test py tests failed exit code 2 130 home runner cache pants named caches pex root venvs s 200996e5 venv bin python3 7 can t open file home runner cache pants named caches pex root venvs d42841a31cba806a3a8511be281c9bb745f3a197 c0d45e5f0038cae13f87b120ee9e80b473618a0b pex Errno 2 No such file or directory 131```

hundreds-father-404 · Answer

ah To clarify the socket timeout is from my local Mac

hundreds-father-404 · Answer

Two separate issues

enough-analyst-54434 · Answer

Not seperate IIUC The 1st leads to Pex erroring converting the exception to an `Error` instance <https github com pantsbuild pex issues 1715>

enough-analyst-54434 · Answer

Oh gotcha Well that CI error no clue

enough-analyst-54434 · Answer

Yeah that s reproducible afaict IFF ` home runner cache pants named caches pex root venvs d42841a31cba806a3a8511be281c9bb745f3a197 c0d45e5f0038cae13f87b120ee9e80b473618a0b ` exists but is empty If you then delete the empty ` home runner cache pants named caches pex root venvs d42841a31cba806a3a8511be281c9bb745f3a197 c0d45e5f0038cae13f87b120ee9e80b473618a0b ` dir leaving just the parent dir behind ` home runner cache pants named caches pex root venvs d42841a31cba806a3a8511be281c9bb745f3a197 ` everything works and the venv re builds Baked in to this whole scheme to save 40ms of overhead from running from the ` venv` PEX file directly is the assumption that the PEX ROOT won t be tampered with It can be missing and a rebuild happens but if there is a targeted delete of interior contents all bets are off

enough-analyst-54434 · Answer

Now it of course seems very improbable there was a targeted delete run in CI so that leaves open the question of how that atomic directory could have no contents or partial contents

enough-analyst-54434 · Answer

gt but if there is a targeted delete of interior contents all bets are off Because to check for this would require an operation slower than or roughly taking the same time as the 40ms thus negating the whole point

enough-analyst-54434 · Answer

So I d love to understand what happened there but I suspect a retry will work or at least terminate in some other error There is 0 useful information you ll erase with a retry since we ve got just that 1 log line to go on

hundreds-father-404 · Answer

Also it s awesome that github preserves prior runs There is no downside to re running CI except for the very real problem that it allows you to paper over problems that we should solve guilty