Running into a weird issue with Pants which worked before It

Question

Running into a weird issue with Pants which worked before It s unable to build requirements pex Failing with a requirement parsing error Details in thread

big-xylophone-43403 · Answer

Pants version `2 10 0`

big-xylophone-43403 · Answer

```16 38 03 43 ERROR 1 Exception encountered Engine traceback in select in pants core goals test run tests in pants backend python goals pytest runner run python test src python func olorailsmenugetter tests test app py test py38 in pants backend python goals pytest runner setup pytest for target in pants backend python util rules pex create pex in pants backend python util rules pex build pex requirements pex in pants engine process fallible to exec result or raise Traceback most recent call last File Users dmistry cache pants setup bootstrap Darwin x86 64 pants vwr5Ve install lib python3 9 site packages pants engine process py line 285 in fallible to exec result or raise raise ProcessExecutionFailure pants engine process ProcessExecutionFailure Process Building requirements pex with 3 requirements boto3 gh core ghlambda failed with exit code 1 stdout stderr pex Resolving interpreters pex Resolving interpreters 0 1ms pex Building pex pex Building pex Resolving distributions boto3 gh core ghlambda pex Building pex Resolving distributions boto3 gh core ghlambda Resolving requirements pex Building pex Resolving distributions boto3 gh core ghlambda Resolving requirements Resolving for Users dmistry pyenv versions 3 8 13 bin python3 8 pex Spawning a maximum of 3 parallel jobs to process Users dmistry pyenv versions 3 8 13 bin python3 8 pex Hashing pex pex Hashing pex 86 7ms pex Isolating pex pex Isolating pex 0 1ms Running command python setup py egg info running egg info creating private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info writing private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info PKG INFO writing dependency links to private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info dependency links txt writing requirements to private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info requires txt writing top level names to private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info top level txt writing manifest file private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info SOURCES txt reading manifest file private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info SOURCES txt reading manifest template warning no files found matching thrift under directory jaeger client warning no files found matching yaml warning no files found matching json under directory config warning no files found matching yaml under directory config warning no files found matching rst under directory docs writing manifest file private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp pip pip egg info m5r1z055 jaeger client egg info SOURCES txt ERROR Exception Traceback most recent call last File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 3021 in dep map return self dep map File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 2815 in getattr raise AttributeError attr AttributeError DistInfoDistribution dep map During handling of the above exception another exception occurred Traceback most recent call last File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor packaging requirements py line 113 in init req = REQUIREMENT parseString requirement string File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pyparsing py line 1955 in parseString raise exc File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pyparsing py line 3814 in parseImpl raise ParseException instring loc self errmsg self pip vendor pyparsing ParseException Expected stringEnd found at char 23 line 1 col 24 During handling of the above exception another exception occurred Traceback most recent call last File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 3101 in init super Requirement self init requirement string File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor packaging requirements py line 115 in init raise InvalidRequirement pip vendor packaging requirements InvalidRequirement Parse error at Expected stringEnd During handling of the above exception another exception occurred Traceback most recent call last File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip internal cli base command py line 223 in main status = self run options args File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip internal cli req command py line 180 in wrapper return func self options args File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip internal commands download py line 130 in run requirement set = resolver resolve File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip internal resolution resolvelib resolver py line 121 in resolve self result = resolver resolve File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor resolvelib resolvers py line 453 in resolve state = resolution resolve requirements max rounds=max rounds File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor resolvelib resolvers py line 347 in resolve failure causes = self attempt to pin criterion name criterion File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor resolvelib resolvers py line 207 in attempt to pin criterion criteria = self get criteria to update candidate File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor resolvelib resolvers py line 198 in get criteria to update for r in self p get dependencies candidate File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip internal resolution resolvelib provider py line 170 in get dependencies return File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip internal resolution resolvelib provider py line 170 in lt listcomp gt return File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip internal resolution resolvelib candidates py line 247 in iter dependencies requires = self dist requires if with requires else File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 2736 in requires dm = self dep map File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 3023 in dep map self dep map = self compute dependencies File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 3033 in compute dependencies reqs extend parse requirements req File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 3094 in parse requirements yield Requirement line File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pkg resources init py line 3103 in init raise RequirementParseError str e pip vendor pkg resources RequirementParseError Parse error at Expected stringEnd pid 47076 gt Users dmistry cache pants named caches pex root venvs 44f0d229c64d262df3c9196eaa181a922a2a17cd 5190f2bb1c910d0c3977d742bb12392b7f02f9f9 pex disable pip version check no python version warning exists action a isolated vvv cache dir Users dmistry cache pants named caches pex root log private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp tmp5un1 0h6 pip log download dest private var folders z1 8 j4n7t17h15skx5y6h69whh0000gp T process executionYS0bXh tmp tmp6l7js 56 Users dmistry pyenv versions 3 8 13 bin python3 8 boto3 gh core ghlambda index url extra index url retries 5 timeout 15 exited with 2 and STDERR ```

big-xylophone-43403 · Answer

The project only has 3 dependencies 2 first party and 1 3rd party boto3

big-xylophone-43403 · Answer

with this requirements macro ```python requirements name= reqs overrides= ghlambda dependencies reqs boto3 module mapping= gh core gh ```

big-xylophone-43403 · Answer

If I remove the undeclared dependency boto3 everything works

enough-analyst-54434 · Answer

Worked before in time before a recent Pants upgrade any more info on what may have changed

enough-analyst-54434 · Answer

Also what is gh core That does not appear to be on PyPI

big-xylophone-43403 · Answer

that is our in house lib

big-xylophone-43403 · Answer

Both gh core and ghlambda

enough-analyst-54434 · Answer

Can you share its requirements Basically can you share the public PyPI root set of reqs

enough-analyst-54434 · Answer

The more you can share the better of course Hard to debug without knowing what is being resolved

enough-analyst-54434 · Answer

Or is boto3 it Do the 1st party actually depend on 0 3rdparty except for boto3

big-xylophone-43403 · Answer

They do depend on other 3rdparty libs Let me share the full list

enough-analyst-54434 · Answer

Thank you That at least allows a quick rule in out of Pex vs Pants ti whittle things down

enough-analyst-54434 · Answer

Pants 2 10 0 is Pex 2 1 71 and `$ pex python python3 8 pex==2 1 71 cpex boto3 o example pex` works for example

big-xylophone-43403 · Answer

Here is the dep tree ```ghlambda==0 5 6 datadog lambda required Any installed 3 60 0 datadog required gt =0 41 0 lt 0 42 0 installed 0 41 0 decorator required gt =3 3 2 installed 5 1 1 requests required gt =2 6 0 installed 2 28 1 certifi required gt =2017 4 17 installed 2022 6 15 charset normalizer required gt =2 lt 3 installed 2 1 0 idna required gt =2 5 lt 4 installed 3 3 urllib3 required gt =1 21 1 lt 1 27 installed 1 26 10 ddtrace required gt =0 61 1 lt 0 62 0 installed 0 61 1 attrs required gt =19 2 0 installed 21 4 0 packaging required gt =17 1 installed 21 3 pyparsing required gt =2 0 2 =3 0 5 installed 3 0 9 protobuf required gt =3 lt 4 installed 3 20 1 six required gt =1 12 0 installed 1 16 0 tenacity required gt =5 installed 8 0 1 wrapt required gt =1 11 2 lt 2 0 0 installed 1 14 1 gh core required gt =0 1 22 installed 0 2 23 boto3 required lt 1 24 0 installed 1 23 10 botocore required gt =1 26 10 lt 1 27 0 installed 1 26 10 jmespath required gt =0 7 1 lt 2 0 0 installed 1 0 1 python dateutil required gt =2 1 lt 3 0 0 installed 2 8 2 six required gt =1 5 installed 1 16 0 urllib3 required gt =1 25 4 lt 1 27 installed 1 26 10 jmespath required gt =0 7 1 lt 2 0 0 installed 1 0 1 s3transfer required gt =0 5 0 lt 0 6 0 installed 0 5 2 botocore required gt =1 12 36 lt 2 0a 0 installed 1 26 10 jmespath required gt =0 7 1 lt 2 0 0 installed 1 0 1 python dateutil required gt =2 1 lt 3 0 0 installed 2 8 2 six required gt =1 5 installed 1 16 0 urllib3 required gt =1 25 4 lt 1 27 installed 1 26 10 dataclasses json required Any installed 0 5 7 marshmallow required gt =3 3 0 lt 4 0 0 installed 3 17 0 packaging required gt =17 0 installed 21 3 pyparsing required gt =2 0 2 =3 0 5 installed 3 0 9 marshmallow enum required gt =1 5 1 lt 2 0 0 installed 1 5 1 marshmallow required gt =2 0 0 installed 3 17 0 packaging required gt =17 0 installed 21 3 pyparsing required gt =2 0 2 =3 0 5 installed 3 0 9 typing inspect required gt =0 4 0 installed 0 7 1 mypy extensions required gt =0 3 0 installed 0 4 3 typing extensions required gt =3 7 4 installed 4 3 0 datadog required gt =0 10 0 installed 0 41 0 decorator required gt =3 3 2 installed 5 1 1 requests required gt =2 6 0 installed 2 28 1 certifi required gt =2017 4 17 installed 2022 6 15 charset normalizer required gt =2 lt 3 installed 2 1 0 idna required gt =2 5 lt 4 installed 3 3 urllib3 required gt =1 21 1 lt 1 27 installed 1 26 10 dnspython required Any installed 2 2 1 jaeger client required gt 4 5 0 installed 4 8 0 opentracing required gt =2 1 lt 3 0 installed 2 4 0 threadloop required gt =1 lt 2 installed 1 0 2 tornado required Any installed 6 2 thrift required Any installed 0 16 0 six required gt =1 7 2 installed 1 16 0 tornado required gt =4 3 installed 6 2 jmespath required gt =0 9 3 installed 1 0 1 marshmallow required Any installed 3 17 0 packaging required gt =17 0 installed 21 3 pyparsing required gt =2 0 2 =3 0 5 installed 3 0 9 opentracing required gt =2 4 0 installed 2 4 0 pyformance required gt =10 2 2 installed 10 2 6 mock required gt =2 0 0 installed 4 0 3 six required Any installed 1 16 0 python dateutil required gt =2 6 1 installed 2 8 2 six required gt =1 5 installed 1 16 0 pytz required gt =2016 6 1 installed 2022 1 PyYAML required gt =5 1 installed 6 0 requests required gt =2 21 0 installed 2 28 1 certifi required gt =2017 4 17 installed 2022 6 15 charset normalizer required gt =2 lt 3 installed 2 1 0 idna required gt =2 5 lt 4 installed 3 3 urllib3 required gt =1 21 1 lt 1 27 installed 1 26 10 setuptools required Any installed 56 0 0 ```

enough-analyst-54434 · Answer

This is a Poetry venv listing or Pip based

big-xylophone-43403 · Answer

pip based

enough-analyst-54434 · Answer

Can you provide a freeze instead that s a bit easier to work with

big-xylophone-43403 · Answer

Sure ```attrs==21 4 0 boto3==1 23 10 botocore==1 26 10 certifi==2022 6 15 charset normalizer==2 1 0 dataclasses json==0 5 7 datadog==0 41 0 datadog lambda==3 60 0 ddtrace==0 61 1 decorator==5 1 1 dnspython==2 2 1 gh core==0 2 23 ghlambda==0 5 6 idna==3 3 jaeger client==4 8 0 jmespath==1 0 1 marshmallow==3 17 0 marshmallow enum==1 5 1 mock==4 0 3 mypy extensions==0 4 3 opentracing==2 4 0 packaging==21 3 pipdeptree==2 2 1 protobuf==3 20 1 pyformance==10 2 6 pyparsing==3 0 9 python dateutil==2 8 2 pytz==2022 1 PyYAML==6 0 requests==2 28 1 s3transfer==0 5 2 six==1 16 0 tenacity==8 0 1 threadloop==1 0 2 thrift==0 16 0 tornado==6 2 typing inspect==0 7 1 typing extensions==4 3 0 urllib3==1 26 10 wrapt==1 14 1```

enough-analyst-54434 · Answer

Thanks

enough-analyst-54434 · Answer

While I check that and back on what has changed do you use `python distribution` targets for any of the internal dependencies

enough-analyst-54434 · Answer

OK this works fine where `rwquirements txt` contains the freeze you provided ```$ grep v E gh core|ghlambda|pyformance requirements txt | xargs ~ venv pex bin pex python python3 8 pex==2 1 71 cpex otest resolve pex```

big-xylophone-43403 · Answer

Yes We have a Pants based monorepo which publishes many python distributions

enough-analyst-54434 · Answer

I had to exclude pyformance since ```ERROR Could not find a version that satisfies the requirement pyformance==10 2 6 from r requirements txt line 23 from versions 0 2 0 2 1 0 2 3 0 2 4 0 2 5 0 3 1 0 3 2 0 3 3 0 3 4 0 4 ERROR No matching distribution found for pyformance==10 2 6 from r requirements txt line 23 ```

big-xylophone-43403 · Answer

Yeah we use a forked version that hosted internally

enough-analyst-54434 · Answer

gt Yes We have a Pants based monorepo which publishes many python distributions OK so do any of those `python distribution` targets have recent changes Do they use custom `setup py` with maybe bad `install requires`

enough-analyst-54434 · Answer

The parse error looks like an errant string list somewhere ` `

big-xylophone-43403 · Answer

There are recent changes But nothing looks suspicious

big-xylophone-43403 · Answer

The puzzling thing is if I remove the `boto3` dependency from the project I m getting the error in it all works fine

enough-analyst-54434 · Answer

Ok and circling back are there recent change to the Pants version or have you been on 2 10 0 when all this was working

big-xylophone-43403 · Answer

No changes to Pants version or the toml files

enough-analyst-54434 · Answer

Can you get dirty and hack in a debug print ```Traceback most recent call last File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor packaging requirements py line 113 in init req = REQUIREMENT parseString requirement string File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pyparsing py line 1955 in parseString raise exc File Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor pyparsing py line 3814 in parseImpl raise ParseException instring loc self errmsg self pip vendor pyparsing ParseException Expected stringEnd found at char 23 line 1 col 24 ``` That suggests adding a `print f gt gt gt requirement string file=sys stderr ` just above ` Users dmistry cache pants named caches pex root venvs s 66ef3043 venv lib python3 8 site packages pip vendor packaging requirements py` line 113

enough-analyst-54434 · Answer

At least we d see the requirement string its choking on and that might help things along

big-xylophone-43403 · Answer

Good idea Let me try that

big-xylophone-43403 · Answer

Ah it s the botocore dependency ``` gt gt gt gt gt Parsing requirement = boto3 gt gt gt gt gt Parsing requirement = botocore gt =1 3 0 lt 1 4 0 ```

enough-analyst-54434 · Answer

Ok Hopefully you can get a quick grep for that string

enough-analyst-54434 · Answer

I have no idea where that s coming from

big-xylophone-43403 · Answer

I think it s because we don t use lockfiles So there is some backtracking going on in resolving the boto3 lib

enough-analyst-54434 · Answer

So you hypothesize some old version of boto3 has botched Requires Dist metadata with the stray trailing ` ` and Pip chokes on that during a backtrack

big-xylophone-43403 · Answer

Yes I think I found it slightly smiling face <https github com boto boto3 commit 548391232e4ca510600c187c8674671d0f3db44a diff fa602a8a75dc9dcc92261bac5f533c2a85e34fcceaff63b3a3a81d9acde2fc52R6|https github com boto boto3 commit 548391232e4ca510600c187c8674671d0f3db44a diff fa602a8a75dc9dcc92261bac5f53 85e34fcceaff63b3a3a81d9acde2fc52R6>

enough-analyst-54434 · Answer

Ah excellent That should really yank that

big-xylophone-43403 · Answer

I ll look to start using lockfiles in that project

big-xylophone-43403 · Answer

Thanks for you help thumbsup

enough-analyst-54434 · Answer

The lock file resolve will hit the same issue of course Once the lock is created you re good to go but still the same root issue calculating the lock

enough-analyst-54434 · Answer