bitter-orange-16997
03/29/2022, 4:39 PM1044.85s Building requirements.pex with 21 requirements: Jinja2, SQLAlchemy==1.4.25, aio-pika, aiofile, aiosmtplib, alembic>=1.7.6, asgi-lifespan, asyncpg, fastapi==0.63.0, httpx, numpy, passlib[bcrypt], pydantic[email], pytest-lazy-fixture, python-dateutil, python-jose==3.2.0, python-multipart==0.0.5, pytz, sqlalchemy-stubs, tenacity, uvicorn[standard]==0.17.0.post1
bitter-ability-32190
03/29/2022, 4:53 PMit does eventually terminate so that leaves us the first optionSo it finished?
bitter-orange-16997
03/29/2022, 4:53 PMbitter-ability-32190
03/29/2022, 4:54 PM[python]
settings in your TOML?bitter-orange-16997
03/29/2022, 4:55 PM[python-infer]
inits = true
[python]
interpreter_constraints = ["CPython==3.8.*"]
requirement_constraints = "constraints.txt"
resolve_all_constraints = false
[python-repos]
repos = [
"<https://download.pytorch.org/whl/torch_stable.html>",
"<https://dl.fbaipublicfiles.com/detectron2/wheels/cu111/torch1.8/index.html>",
"<https://download.openmmlab.com/mmcv/dist/cu111/torch1.8.0/index.html>",
]
[python-bootstrap]
search_path = [
"<ASDF>",
"<PYENV>",
"<PATH>",
]
[pytest]
args = ["-vv"]
Bootstrapping Pants using /usr/bin/python3.9
verbosity = 1
in [pex]
help?witty-crayon-22786
03/29/2022, 5:11 PMpy-spy
(https://github.com/benfred/py-spy) to see what it (and any child processes, in particular: PIP) are doing[pex].verbosity
would help, as it will render debug output when the process completes. 3
is decently verbose.bitter-orange-16997
03/29/2022, 5:12 PMresolve_all_constraints = false
witty-crayon-22786
03/29/2022, 5:14 PMbitter-orange-16997
03/29/2022, 5:15 PMtrue
and on the first run so far: 244.01s Resolving constraints.txt
witty-crayon-22786
03/29/2022, 5:17 PMbitter-orange-16997
03/29/2022, 5:18 PMwitty-crayon-22786
03/29/2022, 5:19 PMresolve_all_constraints=True
will be faster.bitter-orange-16997
03/29/2022, 5:21 PMwitty-crayon-22786
03/29/2022, 5:21 PMbitter-orange-16997
03/29/2022, 5:21 PMbitter-ability-32190
03/29/2022, 5:24 PMtorch
is quite the beefy boy. I'm no longer surprised at this (albeit 1hr is execssive)bitter-orange-16997
03/29/2022, 5:25 PM17:09:05.41 [INFO] Long running tasks:
3629.50s Building requirements.pex with 21 requirements: Jinja2, SQLAlchemy==1.4.25, aio-pika, aiofile, aiosmtplib, alembic>=1.7.6, asgi-lifespan, asyncpg, fastapi==0.63.0, httpx, numpy, passlib[bcrypt], pydantic[email], pytest-lazy-fixture, python-dateutil, python-jose==3.2.0, python-multipart==0.0.5, pytz, sqlalchemy-stubs, tenacity, uvicorn[standard]==0.17.0.post1
3719.33s Building requirements.pex with 23 requirements: SQLAlchemy==1.4.25, alembic>=1.7.6, celery[redis]==5.2.3, cloudpickle==1.6.0, extract-msg==0.28.7, fastapi==0.63.0, func-timeout~=4.3.5, gensim, libpff-python-ratom==20200808, motor~=2.5.1, nltk==3.6.2, numpy, pg8000==1.16.6, pydantic[email], pymongo<4,~=3.12.1, python-jose==3.2.0, python-multipart==0.0.5, requests==2.21.0, scikit-learn, sqlalchemy-stubs, sse-starlette==0.7.2, tenacity, watchdog~=2.1.6
./pants fmt --changed-since=origin/develop
takes 45 seconds and counting on black PEX something somethingbright-book-6256
07/07/2022, 11:59 AMbitter-orange-16997
07/07/2022, 12:19 PMbright-book-6256
07/07/2022, 12:26 PMbitter-orange-16997
07/07/2022, 12:26 PM$ cloc pypi_proxy/
7 text files.
7 unique files.
1 file ignored.
<http://github.com/AlDanial/cloc|github.com/AlDanial/cloc> v 1.86 T=0.01 s (767.0 files/s, 41529.9 lines/s)
-------------------------------------------------------------------------------
Language files blank comment code
-------------------------------------------------------------------------------
Python 7 115 0 264
-------------------------------------------------------------------------------
SUM: 7 115 0 264
-------------------------------------------------------------------------------
bright-book-6256
07/07/2022, 12:28 PMbitter-orange-16997
07/07/2022, 12:29 PMbright-book-6256
07/07/2022, 12:29 PMbitter-orange-16997
07/07/2022, 12:30 PMbright-book-6256
07/07/2022, 12:31 PM⠈ 917.84s Building requirements.pex with 6 requirements: apache-airflow-providers-slack~=3.0.0, apache-airflow[amazon,docker]~=2.0.2, boto3<2.0,>=1.17, pydantic<2.0,>=1.9, pyyaml<6.0.0,>=5.4.1, ruamel.yaml~=0.17
bitter-orange-16997
07/07/2022, 12:32 PMbright-book-6256
07/07/2022, 12:32 PMbitter-orange-16997
07/07/2022, 12:32 PMbright-book-6256
07/07/2022, 12:32 PMbitter-orange-16997
07/07/2022, 12:33 PM[python-repos]
indexes = [
"<https://your-artifactory.com/>"
]
[global]
index-url = <https://your-artifactory.com/>
bright-book-6256
07/07/2022, 12:36 PM.pants.rc
for example), but I'm sure that both are using artifactory because I can see the URL on the logsbitter-orange-16997
07/07/2022, 12:39 PMecho "127.0.0.1 <http://pypi.org|pypi.org>" > /etc/hosts