pantsbuild #general

Channels

welcome

github-notifications

announce

hundreds-father-404

07/10/2020, 11:49 PM

For any Bandit users, we noticed it started breaking about 4 hours ago from the release of a dependency of Bandit. If you get

NotADirectoryError

, the fix is to add

extra_requirements.add = ["stevedore>=2.0.1,<3"]

to the

[bandit]

section in your

pants.toml

Posted in #lang-python

happy-kitchen-89482

07/13/2020, 6:38 PM

Currently

help-all

dumps out help for all scopes in the same human-readable format as help for a single scope. This seems not very useful, as that much data is inherently not human-readable, and presumably people were grepping the output anyway. I was thinking of making it instead dump out a big JSON blob containing all help, which is a feature we need anyway. That can still be grepped (or jq'd), but it would have a consistent structure, unlike the human-readable format, which we might change from time to time for purely human reasons. Any objections?

👍 2

happy-kitchen-89482

07/13/2020, 6:38 PM

Alternatively we can create yet another help command (

help-json

or something) which seems very extra. We already have a lot going on.

important-librarian-62877

07/13/2020, 11:06 PM

Hey there, I at one point had found a page that listed all the pants targets, but I seem to have lost it. Does anybody know where that might be?

clever-table-90691

07/14/2020, 4:43 PM

Hi there, I’ve got a question regarding

./pant awslambda

, we are currently on PANTS

v1.28.0

When pants is building an awlambda target, it seems to be always using python 2.7 even there is python 3.8 installed on our CI/CD environment, we’ve also specified the

interpreter_constraints = ["CPython>=3.7"]

in the pants.ci.toml file Is there a way to enforce it to use python 3.8? Here is part of the trace stack:

Copy code

pid: 14794 -> /usr/bin/python2.7 /tmp/process-executionAmQ08c/pex_root/pip.pex/d3323a933395f1fea4b421b92e99bd2c3d524e6c --disable-pip-version-check --isolated --no-python-version-warning -q --cache-dir /tmp/process-executionAmQ08c/pex_root download --dest /tmp/tmpsuxiy3/manylinux2014_x86_64-cp-38-cp38 --index-url <https://pypi.org/simple/> --header Cache-Control:max-age=3600 --retries 5 --timeout 15 --platform manylinux2014_x86_64 --implementation cp --python-version 38 --abi cp38 --only-binary :all: --constraint constraints.txt boto3==1.12.20 idna<2.10 requests==2.23.0 ruamel.yaml==0.16.10 snowflake-sqlalchemy==1.2.3 raised Executing /usr/bin/python2.7 /tmp/process-executionAmQ08c/pex_root/pip.pex/d3323a933395f1fea4b421b92e99bd2c3d524e6c --disable-pip-version-check --isolated --no-python-version-warning -q --cache-dir /tmp/process-executionAmQ08c/pex_root download --dest /tmp/tmpsuxiy3/manylinux2014_x86_64-cp-38-cp38 --index-url <https://pypi.org/simple/> --header Cache-Control:max-age=3600 --retries 5 --timeout 15 --platform manylinux2014_x86_64 --implementation cp --python-version 38 --abi cp38 --only-binary :all: --constraint constraints.txt boto3==1.12.20 idna<2.10 requests==2.23.0 ruamel.yaml==0.16.10 snowflake-sqlalchemy==1.2.3 failed with 1

cuddly-flag-68085

07/16/2020, 5:24 PM

We use pants build to build protocol buffers in java codebase. Where can I find the generate java code? Im used to blaze/bazel where it exists under genfiles/ or something similar

helpful-lunch-92084

07/17/2020, 8:40 PM

hi, we’re trying to upgrade pants from 1.18 -> 1.29. we’ve currently configured pants to use ipython for the repl but that doesn’t seem to be working with the v2 engine? Getting a bad file descriptor error from prompt_toolkit.

Copy code

File "/Users/nate/.pex/installed_wheels/76668ef9197325b7555d7f8658f6c5fa043bed68/prompt_toolkit-1.0.18-py3-none-any.whl/prompt_toolkit/terminal/vt100_input.py", line 473, in __enter__
    os.write(self.fileno, b'\x1b[?1l')
OSError: [Errno 9] Bad file descriptor

When i clone the pants repo and run pants on an arbitrary target i seem to encounter this error as well.

Copy code

$ pants repl --shell=ipython src/python/pants/subsystem
20:37:35 [INFO] initializing pantsd...
20:37:37 [INFO] pantsd initialized.
Python 3.6.8 (default, Dec 10 2019, 16:24:15)
Type "copyright", "credits" or "license" for more information.

IPython 5.8.0 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object', use 'object??' for extra details.

In [1]:
Traceback (most recent call last):
  File "/Users/nate/git/pants/.pants.d/tmpfzvz8aqy/ipython-repl.pex/.bootstrap/pex/pex.py", line 401, in execute
    exit_code = self._wrap_coverage(self._wrap_profiling, self._execute)
  File "/Users/nate/git/pants/.pants.d/tmpfzvz8aqy/ipython-repl.pex/.bootstrap/pex/pex.py", line 333, in _wrap_coverage
    return runner(*args)
  File "/Users/nate/git/pants/.pants.d/tmpfzvz8aqy/ipython-repl.pex/.bootstrap/pex/pex.py", line 364, in _wrap_profiling
    return runner(*args)
  File "/Users/nate/git/pants/.pants.d/tmpfzvz8aqy/ipython-repl.pex/.bootstrap/pex/pex.py", line 452, in _execute
    return self.execute_entry(self._pex_info.entry_point)
  File "/Users/nate/git/pants/.pants.d/tmpfzvz8aqy/ipython-repl.pex/.bootstrap/pex/pex.py", line 549, in execute_entry
    return runner(entry_point)
  File "/Users/nate/git/pants/.pants.d/tmpfzvz8aqy/ipython-repl.pex/.bootstrap/pex/pex.py", line 564, in execute_pkg_resources
    return runner()
  File "/Users/nate/.pex/installed_wheels/2928e7ea34defca47fe9b3590872c4898d3d337c/ipython-5.8.0-py3-none-any.whl/IPython/__init__.py", line 119, in start_ipython
    return launch_new_instance(argv=argv, **kwargs)
  File "/Users/nate/.pex/installed_wheels/2141181f135fda3f826e75453c112fc9d4ab5943/traitlets-4.3.3-py2.py3-none-any.whl/traitlets/config/application.py", line 664, in launch_instance
    app.start()
  File "/Users/nate/.pex/installed_wheels/2928e7ea34defca47fe9b3590872c4898d3d337c/ipython-5.8.0-py3-none-any.whl/IPython/terminal/ipapp.py", line 355, in start
    self.shell.mainloop()
  File "/Users/nate/.pex/installed_wheels/2928e7ea34defca47fe9b3590872c4898d3d337c/ipython-5.8.0-py3-none-any.whl/IPython/terminal/interactiveshell.py", line 495, in mainloop
    self.interact()
  File "/Users/nate/.pex/installed_wheels/2928e7ea34defca47fe9b3590872c4898d3d337c/ipython-5.8.0-py3-none-any.whl/IPython/terminal/interactiveshell.py", line 478, in interact
    code = self.prompt_for_code()
  File "/Users/nate/.pex/installed_wheels/2928e7ea34defca47fe9b3590872c4898d3d337c/ipython-5.8.0-py3-none-any.whl/IPython/terminal/interactiveshell.py", line 372, in prompt_for_code
    pre_run=self.pre_prompt, reset_current_buffer=True)
  File "/Users/nate/.pex/installed_wheels/76668ef9197325b7555d7f8658f6c5fa043bed68/prompt_toolkit-1.0.18-py3-none-any.whl/prompt_toolkit/interface.py", line 411, in run
    with self.input.raw_mode():
  File "/Users/nate/.pex/installed_wheels/76668ef9197325b7555d7f8658f6c5fa043bed68/prompt_toolkit-1.0.18-py3-none-any.whl/prompt_toolkit/terminal/vt100_input.py", line 473, in __enter__
    os.write(self.fileno, b'\x1b[?1l')
OSError: [Errno 9] Bad file descriptor

I checked the open issues and prs on github and didn’t find anything. Is this a known issue? Or is there something with my current system that’s causing this? I’m currently on Mac 10.14.6 and running pyenv with python 3.6.8.

echoing-manchester-70122

07/17/2020, 9:23 PM

pants binary distribution site down?

echoing-manchester-70122

07/17/2020, 9:23 PM

Copy code

This site can't be <http://reachedbinaries.pantsbuild.org|reachedbinaries.pantsbuild.org>'s server IP address could not be found.
DNS_PROBE_FINISHED_NXDOMAIN

aloof-angle-91616

07/17/2020, 9:24 PM

i repro the issue with

ping

aloof-angle-91616

07/17/2020, 9:25 PM

i messaged this to #infra, feel free to follow along there

aloof-angle-91616

07/17/2020, 9:27 PM

thanks so much for reporting ❤️

👍 1

echoing-manchester-70122

07/17/2020, 9:27 PM

apparently cloudflare is currently having an outage

✍️ 1

happy-kitchen-89482

07/17/2020, 9:47 PM

That's exciting...

melodic-optician-41260

07/20/2020, 11:25 AM

Hi guys, how can I list everything on the classpath for a given build target?

happy-kitchen-89482

07/20/2020, 5:32 PM

@fancy-queen-20734 Randomly pinging you as someone still versed in JVM stuff... Can you help with this ^ Thanks!

👀 1

polite-vase-75369

07/21/2020, 2:41 PM

How does one use

--ignore-pants-warnings=

to ignore all warnings?

aloof-angle-91616

07/21/2020, 2:42 PM

i want to say that it accepts the same syntax as PYTHONWARNINGS from the earnings module so you could do i think

--ignore-pants-warnings=ignore::

aloof-angle-91616

07/21/2020, 2:43 PM

will double check that

aloof-angle-91616

07/21/2020, 2:43 PM

sorry to be clear that’s not a pants target spec for

ignore::

that’s just what the warnings module uses

polite-vase-75369

07/21/2020, 2:43 PM

oh so like --ignore-pants-warnings=“ignore::” ?

aloof-angle-91616

07/21/2020, 2:44 PM

yes yes sorry

aloof-angle-91616

07/21/2020, 2:45 PM

hm, might not be that. might just be a list of regex

aloof-angle-91616

07/21/2020, 2:45 PM

could possibly do

--ignore-pants-warnings=.*

aloof-angle-91616

07/21/2020, 2:45 PM

looking at code now

polite-vase-75369

07/21/2020, 2:45 PM

🙏

polite-vase-75369

07/21/2020, 2:45 PM

passing star on the command line isn’t the easiest 😛

aloof-angle-91616

07/21/2020, 2:45 PM

yes yes i would quote it like you did above

aloof-angle-91616

07/21/2020, 2:46 PM

we end up calling this statement for each element of the

--ignore-pants-warnings

option:

Copy code

warnings.filterwarnings(action="ignore", message=message_regexp)

so i'm pretty sure it should be just regexp, like

'.*'

aloof-angle-91616

07/21/2020, 2:47 PM

let us know if that works