Hm macOS jobs continue to fail today with
```./pa...
# developmenth
hundreds-father-404
05/04/2022, 3:55 PMHm macOS jobs continue to fail today with
Copy code
./pants: line 64: /Users/runner/.cache/pants/pants_dev_deps/Darwin.x86_64.i386.py37.venv/bin/python: No such file or directory
303hundreds-father-404
05/04/2022, 3:56 PMhundreds-father-404
05/04/2022, 3:56 PMI don't see any changes to the macOS runner in the GitHub changelog. And earlier in the CI run it is still showing that we're activating Python 3.7 correctly
hundreds-father-404
05/04/2022, 3:56 PMI will try to dig into this now. I was hoping it would just fix itself 🙈
hundreds-father-404
05/04/2022, 4:22 PMUhhh any Linux wisdom on what's going on here?
hundreds-father-404
05/04/2022, 4:22 PM Copy code
+ ls -l /Users/runner/.cache/pants/pants_dev_deps/Darwin.x86_64.i386.py37.venv/bin
...
lrwxr-xr-x 1 runner staff 9 Apr 30 03:32 python -> python3.7
196
lrwxr-xr-x 1 runner staff 9 Apr 30 03:32 python3 -> python3.7
197
lrwxr-xr-x 1 runner staff 61 Apr 30 03:32 python3.7 -> /Users/runner/hostedtoolcache/Python/3.7.12/x64/bin/python3.7
198
-rwxr-xr-x 1 runner staff 276 Apr 30 03:33 wheelhundreds-father-404
05/04/2022, 4:22 PM Copy code
+ /Users/runner/.cache/pants/pants_dev_deps/Darwin.x86_64.i386.py37.venv/bin/python --version
204
./pants: line 50: /Users/runner/.cache/pants/pants_dev_deps/Darwin.x86_64.i386.py37.venv/bin/python: No such file or directoryw
witty-crayon-22786
05/04/2022, 4:41 PM@hundreds-father-404: that shows a symlink, but is the destination alive?
h
hundreds-father-404
05/04/2022, 4:41 PMRemoving the cache action fixes this. I think we for some reason have a poisened cache
w
witty-crayon-22786
05/04/2022, 4:41 PMi.e. is
/Users/runner/hostedtoolcache/Python/3.7.12/x64/bin/python3.7👍 1
h
hundreds-father-404
05/04/2022, 4:42 PMI do not see a way with you github action to purge caches
ah so cache key should include
/Users/runner/hostedtoolcache/Python/**hundreds-father-404
05/04/2022, 5:09 PMw
witty-crayon-22786
05/04/2022, 5:11 PMthanks for looking at that.
❤️ 1
h
hundreds-father-404
05/04/2022, 7:34 PMCI is fixed. Reminder to pull
mainhundreds-father-404
05/05/2022, 4:05 PMUgh some jobs keep failing. But then seem to work again after second run? Maybe lets see if this still happens tomorrow and turn off caching off venv if so. It shaves off about ~30 seconds from each job iiuc
hundreds-father-404
05/05/2022, 4:43 PMUgh. Restarting isn't working, and release branches like 2.11 are failing now. I'm gonna drop the cache 😕
hundreds-father-404
05/05/2022, 6:24 PM@witty-crayon-22786 heading out to lunch. feel free t o merge https://github.com/pantsbuild/pants/pull/15342. NB i do not understood the problem
w
witty-crayon-22786
05/05/2022, 7:10 PMblargh. thanks Eric.