I am having some issues updating to python 3.11 fr...
# general
b
I am having some issues updating to python 3.11 from 3.10. It manifests when I generate the lockfile (
pants generate-lockfiles
). Where I get this error:
Copy code
writing manifest file '/tmp/pants-sandbox-2f5z6H/.tmp/tmpjnm_zjwe/build/jax.egg-info/SOURCES.txt'
creating '/tmp/pants-sandbox-2f5z6H/.tmp/tmpjnm_zjwe/build/jax-0.4.8.dist-info'
Could not gather lock metadata for 1 project with source artifacts:
1. /tmp/pants-sandbox-2f5z6H/.tmp/tmpm7asbr4g/usr.bin.python3.11/multiprocess-0.70.14.tar.gz: Executing /home/sigur
dur/.cache/pants/named_caches/pex_root/venvs/6d9a4230883386f8bc74f0f14c403de3660d52be/73c7d7c618fac01449fa6e57a2121
0c0eb8a8f21/bin/python -sE /home/sigurdur/.cache/pants/named_caches/pex_root/venvs/6d9a4230883386f8bc74f0f14c403de3
660d52be/73c7d7c618fac01449fa6e57a21210c0eb8a8f21/pex -c import sys

import setuptools.build_meta


if not hasattr(setuptools.build_meta, 'prepare_metadata_for_build_wheel'):
    sys.exit(75)

result = setuptools.build_meta.prepare_metadata_for_build_wheel(*('/tmp/pants-sandbox-2f5z6H/.tmp/tmp4ofkpkjq/build
',), **{})
with open('/tmp/pants-sandbox-2f5z6H/.tmp/tmpg61tovek', "w") as fp:
    fp.write(result)
 failed with 1
But it seems like I can manually generate a venv and install all the packages without issues that way; but it seems not to work with pants. Everything works great with python 3.10. Any ideas?
1
e
Yeah, @brave-hair-402 that should do it: With 2.1.133:
Copy code
$ pex pex==2.1.133 -cpex3 -- lock create multiprocess==0.70.14 --interpreter-constraint "==3.11.*" --style universal 2>&1 | tail -20
no previously-included directories found matching 'pypy2.7'
no previously-included directories found matching 'pypy3.6'
adding license file 'LICENSE'
adding license file 'COPYING'
writing manifest file '/tmp/tmpzeo120bi/build/multiprocess.egg-info/SOURCES.txt'
creating '/tmp/tmpzeo120bi/build/multiprocess-0.70.14.dist-info'
error: invalid command 'bdist_wheel'
Could not gather lock metadata for 1 project with source artifacts:
1. /tmp/tmpz95pdu7k/home.jsirois..pyenv.versions.3.11.0rc2.bin.python3.11/multiprocess-0.70.14.tar.gz: Executing /home/jsirois/.pex/venvs/7735da2b87642f0a8689257129d80dbbeb5ca70d/475c36a917e27d0de16737fc99c64c496c845904/bin/python -sE /home/jsirois/.pex/venvs/7735da2b87642f0a8689257129d80dbbeb5ca70d/475c36a917e27d0de16737fc99c64c496c845904/pex -c import sys

import setuptools.build_meta


if not hasattr(setuptools.build_meta, 'prepare_metadata_for_build_wheel'):
    sys.exit(75)

result = setuptools.build_meta.prepare_metadata_for_build_wheel(*('/tmp/tmpzeo120bi/build',), **{})
with open('/tmp/tmprrrl5yrt', "w") as fp:
    fp.write(result)
 failed with 1
With 2.1.134:
Copy code
$ pex pex==2.1.134 -cpex3 -- lock create multiprocess==0.70.14 --interpreter-constraint "==3.11.*" --style universal 2>/dev/null
{"allow_builds": true, "allow_prereleases": false, "allow_wheels": true, "build_isolation": true, "constraints": [], "locked_resolves": [{"locked_requirements": [{"artifacts": [{"algorithm": "sha256", "hash": "a07ffd2351b8c678dfc4a856a3005f8067aea51d6ba6c700796a4d9e280f39f0", "url": "<https://files.pythonhosted.org/packages/be/e3/a84bf2e561beed15813080d693b4b27573262433fced9c1d1fea59e60553/dill-0.3.6-py3-none-any.whl>"}, {"algorithm": "sha256", "hash": "e5db55f3687856d8fbdab002ed78544e1c4559a130302693d839dfe8f93f2373", "url": "<https://files.pythonhosted.org/packages/7c/e7/364a09134e1062d4d5ff69b853a56cf61c223e0afcc6906b6832bcd51ea8/dill-0.3.6.tar.gz>"}], "project_name": "dill", "requires_dists": ["objgraph>=1.7.2; extra == \"graph\""], "requires_python": ">=3.7", "version": "0.3.6"}, {"artifacts": [{"algorithm": "sha256", "hash": "3eddafc12f2260d27ae03fe6069b12570ab4764ab59a75e81624fac453fbf46a", "url": "<https://files.pythonhosted.org/packages/e3/ab/9aafc121c6a3d2470ccdf28f99897e88d324c948893b30e46cb359f595e3/multiprocess-0.70.14.tar.gz>"}], "project_name": "multiprocess", "requires_dists": ["dill>=0.3.6"], "requires_python": ">=3.7", "version": "0.70.14"}], "platform_tag": null}], "path_mappings": {}, "pex_version": "2.1.134", "pip_version": "20.3.4-patched", "prefer_older_binary": false, "requirements": ["multiprocess==0.70.14"], "requires_python": ["==3.11.*"], "resolver_version": "pip-legacy-resolver", "style": "universal", "target_systems": [], "transitive": true, "use_pep517": null}
This upgrade is on main in Pants and cherry-picked into 2.16.x so will go out with both 2.17.0.dev4 and 2.16.0rc1 (we have a lot queued for 2.16.0rc1: https://github.com/pantsbuild/pants/commits/2.16.x !)
b
This does the trick! Thank you. Is there any eta on 2.16.0rc1?
c
yes, it’s being prepped now, so some time later today or during Monday.
👀 1