so shouldn't pants be able to resolve to the earli...
# generalm
mysterious-farmer-45668
10/30/2018, 12:10 AMso shouldn't pants be able to resolve to the earlier version and pick up flask-login
0.2.11e
enough-analyst-54434
10/30/2018, 1:20 AMProbably. This is likely worthy of a bug against pex, but it's also really not ideal:
Copy code
$ pex apache-airflow==1.10.0
**** Failed to install apache-airflow-1.10.0 (caused by: NonZeroExit("received exit code 1 during execution of `['/usr/bin/python3.7', '-', 'bdist_wheel', '--dist-dir=/tmp/tmp9oz6r7sr']` while trying to execute `['/usr/bin/python3.7', '-', 'bdist_wheel', '--dist-dir=/tmp/tmp9oz6r7sr']`")
):
stdout:
stderr:
Traceback (most recent call last):
File "<stdin>", line 9, in <module>
File "setup.py", line 124
async = [
^
SyntaxError: invalid syntax
Traceback (most recent call last):
File "/home/jsirois/.venv/pex/bin/pex", line 11, in <module>
sys.exit(main())
File "/home/jsirois/.venv/pex/lib/python3.7/site-packages/pex/bin/pex.py", line 735, in main
pex_builder = build_pex(reqs, options, resolver_options_builder)
File "/home/jsirois/.venv/pex/lib/python3.7/site-packages/pex/bin/pex.py", line 664, in build_pex
for resolved_dist in resolveds:
File "/home/jsirois/.venv/pex/lib/python3.7/site-packages/pex/resolver.py", line 566, in resolve_multi
use_manylinux=use_manylinux):
File "/home/jsirois/.venv/pex/lib/python3.7/site-packages/pex/resolver.py", line 502, in resolve
return resolver.resolve(resolvables_from_iterable(requirements, builder))
File "/home/jsirois/.venv/pex/lib/python3.7/site-packages/pex/resolver.py", line 300, in resolve
dist = self.build(package, resolvable.options)
File "/home/jsirois/.venv/pex/lib/python3.7/site-packages/pex/resolver.py", line 379, in build
dist = super(CachingResolver, self).build(package, options)
File "/home/jsirois/.venv/pex/lib/python3.7/site-packages/pex/resolver.py", line 258, in build
raise Untranslateable('Package %s is not translateable by %s' % (package, translator))
pex.resolver.Untranslateable: Package SourcePackage('file:///home/jsirois/.pex/build/apache-airflow-1.10.0.tar.gz') is not translateable by ChainedTranslator(WheelTranslator, EggTranslator, SourceTranslator)enough-analyst-54434
10/30/2018, 1:22 AMYou should be able to work around by declaring a direct dep on the correct solution for flask-appbuilder with appropriate comment pointing to the bug you file.
enough-analyst-54434
10/30/2018, 1:23 AMpypi says "Last released: Aug 27, 2018" - clearly no-one actually uses this version of airflow?
enough-analyst-54434
10/30/2018, 1:23 AMOr does everyone install from a git url with a fix or how even is this a thing?
m
mysterious-farmer-45668
10/30/2018, 1:32 AMthat is why i had to put the constraint of <3.7 in my requirements. If you put that constraint i think you'd get a repro... will file an issue with pex.
e
enough-analyst-54434
10/30/2018, 1:37 AMAha - I did not realize that was what the environment marker was for.
enough-analyst-54434
10/30/2018, 1:38 AMThis thing is a nightmare!: "RuntimeError: By default one of Airflow's dependencies installs a GPL dependency (unidecode). To avoid this dependency set SLUGIFY_USES_TEXT_UNIDECODE=yes..."
m
mysterious-farmer-45668
10/30/2018, 1:39 AMI agree -.- i just got handed this ticket but seriously wtf how is nobody else googling for this problem..?
e
enough-analyst-54434
10/30/2018, 1:40 AMRepro - maybe - taking a long time to download the huge dep list
m
mysterious-farmer-45668
10/30/2018, 1:41 AMI got it with
pex apache-airflow==1.10.0 --interpreter-constraint='CPython<3.7'e
enough-analyst-54434
10/30/2018, 1:43 AMAgreed:
Copy code
$ SLUGIFY_USES_TEXT_UNIDECODE=yes pex --python=python2 'apache-airflow==1.10.0; python_version < "3.7"'
Could not satisfy all requirements for flask-login==0.2.11:
flask-login==0.2.11(from: apache-airflow==1.10.0; python_version < "3.7"), Flask-Login<0.5,>=0.3(from: apache-airflow==1.10.0; python_version < "3.7"->flask-appbuilder<2.0.0,>=1.11.1)enough-analyst-54434
10/30/2018, 1:43 AMThat is a clean minimal repro
m
mysterious-farmer-45668
10/30/2018, 1:44 AMe
enough-analyst-54434
10/30/2018, 1:46 AMThank you! As soon as I confirm the workaround works I'll note that on the issue.
enough-analyst-54434
10/30/2018, 1:48 AMOK - workaround works. Hopefully that gets you by until we can devote some time to fixing the pex resolver implementation which likely needs better backtracking.
m
mysterious-farmer-45668
10/30/2018, 1:52 AMhow would i specify it in pants requirement file?
mysterious-farmer-45668
10/30/2018, 1:55 AMJust adding
Flask-AppBuilder==1.11.1 ; python_version < '3.7'e
enough-analyst-54434
10/30/2018, 1:55 AM1st - keep in mind this is a standard pip requirements file. So you'd add
Flask-AppBuilder==1.11.13rdparty/python:apache-airflow3rdparty/python:Flask-AppBuilderenough-analyst-54434
10/30/2018, 1:56 AMIE: requirements.txt contains all your repo requirements, but not all targets depend on all those things (I hope!)
enough-analyst-54434
10/30/2018, 1:56 AMMake sense?
m
mysterious-farmer-45668
10/30/2018, 1:56 AMattempting!
e
enough-analyst-54434
10/30/2018, 1:57 AMIf you have lots of targets with this issue we can talk about a way to DRY this hack up
m
mysterious-farmer-45668
10/30/2018, 1:57 AMI don't understand
add a new fake dependencye
enough-analyst-54434
10/30/2018, 1:58 AMpython_library(name='BillysApp', sources=..., dependencies=[..., '3rdparty/python/Flask-AppBuilder'])enough-analyst-54434
10/30/2018, 1:58 AMIOW you add a dependency to the exiting target needing airflow
enough-analyst-54434
10/30/2018, 1:59 AMIts fake in that that target doesn't actually directly need flask-appbuilder, its just being depended on to influence the resolver
enough-analyst-54434
10/30/2018, 1:59 AMDitto if the target in question is a
python_binaryenough-analyst-54434
10/30/2018, 2:00 AMIf this is still confusing perhaps paste your existing BUILD file with the target you wrote needing airflow.