Hi here, I’ve got the most noobish question:

./pants --version
Bootstrapping pants_deps with requirements:
  /Users/pchevalier/Documents/code/pants/3rdparty/python/requirements.txt
  /Users/pchevalier/Documents/code/pants/3rdparty/python/twitter/commons/requirements.txt
  /Users/pchevalier/Documents/code/pants/pants-plugins/3rdparty/python/requirements.txt
  /Users/pchevalier/Documents/code/pants/contrib/python/src/python/pants/contrib/python/checks/checker/3rdparty/requirements.txt
Using python at /usr/bin/python3
Using base prefix '/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8'
New python executable in /Users/pchevalier/Documents/code/pants/build-support/virtualenvs/Darwin/pants_dev_deps.py38.venv/bin/python3
Also creating executable in /Users/pchevalier/Documents/code/pants/build-support/virtualenvs/Darwin/pants_dev_deps.py38.venv/bin/python
Traceback (most recent call last):
  File "/Users/pchevalier/Documents/code/pants/build-support/virtualenv.dist/virtualenv.py", line 2619, in <module>
    main()
  File "/Users/pchevalier/Documents/code/pants/build-support/virtualenv.dist/virtualenv.py", line 857, in main
    create_environment(
  File "/Users/pchevalier/Documents/code/pants/build-support/virtualenv.dist/virtualenv.py", line 1142, in create_environment
    install_python(home_dir, lib_dir, inc_dir, bin_dir, site_packages=site_packages, clear=clear, symlink=symlink)
  File "/Users/pchevalier/Documents/code/pants/build-support/virtualenv.dist/virtualenv.py", line 1607, in install_python
    shutil.copy(original_python, py_executable)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/shutil.py", line 240, in copyfile
    if _samefile(src, dst):
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/shutil.py", line 217, in _samefile
    return os.path.samefile(src, dst)
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/genericpath.py", line 100, in samefile
    s1 = os.stat(f1)
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

Failed to create venv.

Looks like a virtualenv issue from what I can tell. Do you want to be using Py38? Generally, you should run pants with Py36 or Py37

I’m open-minded 🙂

You can override by setting PY=python3.6 when running pants. See if it makes a difference

Thanks a lot @hundreds-father-404,

PY="python3.7" ./pants --version

did the trick 🙂

Ah alternative might be to upgrade virtualenv to something more recent

How would you go about this? I tried a few things, but honest: the strange world of python environments is full of mistery to me

I think there’s a

virtualenv

script. Bump the version in it

Bumping it to the latest version (`20.0.31') leads to a new error:

./pants --version
Bootstrapping pants_deps with requirements:
  /Users/pchevalier/Documents/code/pants/3rdparty/python/requirements.txt
  /Users/pchevalier/Documents/code/pants/3rdparty/python/twitter/commons/requirements.txt
  /Users/pchevalier/Documents/code/pants/pants-plugins/3rdparty/python/requirements.txt
  /Users/pchevalier/Documents/code/pants/contrib/python/src/python/pants/contrib/python/checks/checker/3rdparty/requirements.txt
Using python at /usr/bin/python3
Downloading <https://pypi.io/packages/source/v/virtualenv/virtualenv-20.0.31.tar.gz>...
##################################################################################################################################################################################################################################### 100.0%##################################################################################################################################################################################################################################### 100.0%##################################################################################################################################################################################################################################### 100.0%
/Library/Developer/CommandLineTools/usr/bin/python3: can't open file '/Users/pchevalier/Documents/code/pants/build-support/virtualenv.dist/virtualenv.py': [Errno 2] No such file or directory

Failed to create venv

Okay, I think that that system Python is pathologically broken from what I can tell. MacOS preinstalled Python is the worst Are you using Pyenv?

No. I’m not even sure where this python in /usr/bin/python3 comes from…

It’s pre-installed and I don’t think safe to uninstall 🙃

uhm ok

It might work to brew install Python. Alternatively, brew install pyenv, do pyenv install 3.6.10, then pyenv global 3.6.10. You also have to set up shims in your .bashrc

Yes, I highly recommend NOT using the MacOS system python, it is weirdly broken