pantsbuild #general

No cached artifacts for 254 targets.
                   Invalidated 254 targets.14:03:36 [WARN] /home/cedriczheng/.cache/pants/setup/bootstrap-Linux-x86_64/1.23.0_py36/lib/python3.6/site-packages/pex/pep425tags.py:274: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp

**** Failed to install importlib_metadata-4.11.3 (caused by: NonZeroExit("received exit code 1 during execution of `['/usr/bin/python2.7', '-s', '-', 'bdist_wheel', '--dist-dir=/tmp/tmpwfro9psz']` while trying to execute `['/usr/bin/python2.7', '-s', '-', 'bdist_wheel', '--dist-dir=/tmp/tmpwfro9psz']`",)
):
stdout:

stderr:
Traceback (most recent call last):
  File "<stdin>", line 13, in <module>
IOError: [Errno 2] No such file or directory: 'setup.py'



               Waiting for background workers to finish.
07:03:38 00:04   [complete]
               FAILURE

happy-kitchen-89482

03/29/2022, 2:25 PM

Yes, importlib_metadata-4.11.3 requires Python 3, as you can see here: https://pypi.org/project/importlib-metadata/4.11.3/

happy-kitchen-89482

03/29/2022, 2:26 PM

Looks like 2.1.3 is the last version that supports Python 2.7

❤️ 1

freezing-area-97131

03/29/2022, 2:28 PM

Ok. I found there is this warning related to this. How do I fix this?

Copy code

No cached artifacts for 71 targets.
                   Invalidated 71 targets.14:25:12 [WARN] /home/cedriczheng/.cache/pants/setup/bootstrap-Linux-x86_64/1.23.0_py36/lib/python3.6/site-packages/pex/pep425tags.py:274: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp

freezing-area-97131

03/29/2022, 2:36 PM

And how do I pin its version? Is it like this:

Copy code

python_requirement_library(
    name='importlib',
    dependencies=[
        ':importlib-metadata',
    ],
)

busy-vase-39202

03/29/2022, 3:39 PM

https://pantsbuild.slack.com/archives/C0D7TNJHL/p1648525570531219

bitter-orange-16997

03/29/2022, 4:39 PM

hey guys, we're seeing some real slowness in our build with pants:

Copy code

1044.85s 	Building requirements.pex with 21 requirements: Jinja2, SQLAlchemy==1.4.25, aio-pika, aiofile, aiosmtplib, alembic>=1.7.6, asgi-lifespan, asyncpg, fastapi==0.63.0, httpx, numpy, passlib[bcrypt], pydantic[email], pytest-lazy-fixture, python-dateutil, python-jose==3.2.0, python-multipart==0.0.5, pytz, sqlalchemy-stubs, tenacity, uvicorn[standard]==0.17.0.post1

🐌 1

bitter-orange-16997

03/29/2022, 4:40 PM

the list of requirements is not insane to the point of it taking that much time so I'm kinda lost as to why this could be happening

bitter-orange-16997

03/29/2022, 4:40 PM

is pants building from source for some or all of these requirements?

bitter-orange-16997

03/29/2022, 4:42 PM

regardless, CPU is barely touched on the machine running the pipeline

bitter-orange-16997

03/29/2022, 4:42 PM

it's a brand new instance with 4 cores and 16 gigs or ram

bitter-orange-16997

03/29/2022, 4:49 PM

it's 2427.34s now

bitter-orange-16997

03/29/2022, 4:49 PM

I'm really open for any suggestion at this point

bitter-ability-32190

03/29/2022, 4:52 PM

If I had to guess it's either a deadlock, or

setup.py

for one of those packages is prompting for info.

bitter-ability-32190

03/29/2022, 4:53 PM

Let's take this to a thread

bitter-orange-16997

03/29/2022, 4:53 PM

it does eventually terminate so that leaves us the first option

bitter-orange-16997

03/29/2022, 4:53 PM

okay

gorgeous-eve-12553

03/29/2022, 5:01 PM

Hello! Does anyone have any examples of combining Poetry + PyOxidizer + Docker ?

gorgeous-eve-12553

03/29/2022, 5:06 PM

Thanks!

bitter-orange-16997

03/29/2022, 6:03 PM

does pants support that sort of syntax in requirements.txt or is that gonna be an issue?

bitter-orange-16997

03/29/2022, 6:04 PM

Copy code

-i <http://some-index.com/simple>
foo-package

happy-kitchen-89482

03/29/2022, 8:07 PM

Yeah, you'll want to use https://www.pantsbuild.org/docs/reference-python-repos as Tom said. Pants ignores that syntax in requirements.txt

high-yak-85899

03/29/2022, 11:00 PM

Anyone have settings they've liked for

update-build-files

formatting? I'm using yapf, but I'm not really crazy about what the defaults do. Here's a good example

Copy code

python_sources(
    overrides={"cloud_storage.py": {
        "dependencies": ["//:reqs#boto3"]
    }})

high-yak-85899

03/30/2022, 12:16 AM

Moving to a separate thread but related to the above: I realized that because I set a file association in vscode to map my BUILD.pants files to the Starlark language, vscode was using

buildifier

as the default formatter.

buildifier

is very rigid so I can't customize it to be like

yapf

. I also can't associate BUILD.pants files with the Python language because vscode will start complaining about a bunch of errors with the language server running on it. Any recommendations from people who may have experienced similar?

freezing-area-97131

03/30/2022, 12:16 AM

@happy-kitchen-89482 I have added

importlib-metadata==2.1.3

in requirement.txt but it still failed. Not sure what’s the correct way to pin the version.

high-yak-85899

03/30/2022, 1:51 AM

It seems like our custom markers defined in

pytest.ini

are sometimes getting ignored by pants and pants is complaining that the markers aren't defined. Not sure how best to reproduce at the moment. I just did a whole run pointing to the problem test with

./pants --no-local-cache path/to/my/marked_test.py

and pytest didn't complain. However, on our build system, I've noticed a few times now where it does complain about the marker being undefined.

happy-kitchen-89482

03/30/2022, 1:54 AM

Hmm, the pytest rules should auto-discover pytest.ini and put it in the sandbox

happy-kitchen-89482

03/30/2022, 1:54 AM

Weird that it's not happening consistently