Hi all! We hit an issue where

pip install -r constraints.txt

works fine, but pants resolving constraint hit this error:

pants.engine.process.ProcessExecutionFailure: Process 'Resolving constraints.txt' failed with exit code 1.
...
ERROR: Failed building wheel for fastparquet
...
FileExistsError: [Errno 17] File exists: '/private/var/folders/sp/r6qw31k954q4r3ytv2psppr80000gp/T/process-execution0CgoPz/.tmp/pip-req-build-phat6ajh/.eggs/numpy-1.21.2-py3.7-macosx-10.16-x86_64.egg'
...
ERROR: Failed cleaning build dir for fastparquet
ERROR: Failed to build one or more wheels

This is when building on Mac OS. And only one of our teammates hit this error, the rest (also using mac OS) built successfully. Any clue?

Hm, do you have the full output from the run?

Ugh, this vaguely rings a bell, I'm pretty sure I've seen something like this before.

Yes. And we can’t repro on someone else’s machine

Ok, at this point it would help to get super heavy on the details. The full constraints.txt would help as well as the full output with

-ldebug --pex-verbosity=9

included. It's probably best to dump this all in an issue to anchor the debugging effort.

Looks like https://github.com/pantsbuild/pants/issues/12870 is that ticket

Yeah. The command output gist has snips - hopefully the total output will be forthcoming and help narrow in.

He just posted the full output 🙏

Hopefully we can get some help on this asap, cuz it's quite likely that if Kyran is hitting this issue, our ML practitioners might too.

This is a bit of a doozy to debug since the error is fully in a pip subprocess - no Pants or Pex involved at that point. Is https://pypi.cbhq.net, perchance an insternal pypi repo we could leverage? The simplest workaround is to build a macOS wheel once - by hand, and upload it there. It looks like fastparquet only publishes pre-built wheels for Linux and Windows and so the mac users are being forced to build the wheel locally and hitting this error.

Yes, internal vendor is possible.

Ok, then I'll update the issue with that rec. That will allow you to move forward under your own control. Debugging the fastparquet cython extension build that uses setup_requires - which is deprecated ... ETC - is going to be very hard.