When running

./pants test

on all the pants repo's tests on my laptop (so it takes several minutes to complete), I see this log

[INFO] Completed: Building pytest_runner.pex

Repeated several times in the output. Is this a bad artifact in the dynamic UI, or are we really building that pex multiple times for some reason?

I was noticing that I wasn't getting any stdout/stderr output until the end of my batch job run from a built pex file. I'm assuming pex is using Popen.communicate or something similar somewhere in the call chain that holds on to the piped output. Is this the expected behavior?

Eventually, I want to adopt poetry in the monorepo I'm working on adding pants to. So, I've been watching the development of both pants and poetry. Pants can extract poetry-style dependencies from multiple pyproject.toml files already. Plus, I just saw an interesting plugin for poetry: https://github.com/jacksmith15/poetry-workspace-plugin How might this plugin make a difference for pants? Looking it over, it doesn't really offer coordination of dependencies or constraints besides adding path-based dependencies on projects in the repo. Where would might this plugin be useful in a pants+poetry repo?

Another thought: I wonder if pants could orchestrate building wheels using poetry instead of building the wheels itself? Pants would collect the relevant files, put them in a temporary directory (a remote execution compatible env) and run poetry in that directory. Or might even expand pyproject.toml with additional poetry settings... Hmm.

https://twitter.com/pantsbuild/status/1425228821578584067 You can leverage incremental adoption in Pants 2 to pay off your technical debt! youtube.com/watch?v=BOhcdR… Pants helps you expose technical debt, address it at your own pace, and avoid piling up new technical debt. Its powerful features & flexible approach help you make code scale. Twitter

I'm trying to run an app that takes command line arguments and it seems to be splitting the arguments based on spaces, even when quoted.

./pants run projects/executable:pex_binary -- --arg1 "many words separated"

I'm using argparse, and it blows up because it's not expecting an argument "words separated". Looking at sys.argv, they're all split up. This doesn't happen when I invoke the pex file directly. argparse's destination "arg1" has a value of "many words separated". Workaround when using pants is to escape all the spaces.

https://twitter.com/natfriedman/status/1425504734530650114 Pants Build retweeted: Oh, almost forgot to mention. New pro tip: Hit '.' on any GitHub repo. 😍 Twitter

https://twitter.com/pantsbuild/status/1425889329369473025 Struggling with a Python test, linter, or formatter? C'mon over to the Pants Build Slack and feel free to think it through aloud. https://t.co/qbb9GS6HTZ We're happy to rubber duck for you, and if that doesn't get you unstuck we know a lot of more concrete ways to help you out. Twitter

Folks, had a problem bootstrapping pants 5.0 for a new user. We've had no trouble, but with pants 2.5.0 and python 3.9 on a new system, this happened, as if pip wasn't seeing the right version of python:

$ ./pants test algorithms::
Bootstrapping Pants using /Users/user/.pyenv/shims/python3.9
Installing pantsbuild.pants==2.5.0 into a virtual environment at /Users/user/.cache/pants/setup/bootstrap-Darwin-x86_64/2.5.0_py39
created virtual environment CPython3.9.2.final.0-64 in 353ms
  creator CPython3Posix(dest=/Users/user/.cache/pants/setup/bootstrap-Darwin-x86_64/pants.xGjbPP/install, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/Users/sohum/Library/Application Support/virtualenv)
    added seed packages: pip==21.1.2, setuptools==57.0.0, wheel==0.36.2
  activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator
Requirement already satisfied: pip in /Users/user/.cache/pants/setup/bootstrap-Darwin-x86_64/pants.xGjbPP/install/lib/python3.9/site-packages (21.1.2)
Collecting pip
  Using cached pip-21.2.4-py3-none-any.whl (1.6 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 21.1.2
    Uninstalling pip-21.1.2:
      Successfully uninstalled pip-21.1.2
Successfully installed pip-21.2.4
ERROR: Could not find a version that satisfies the requirement pantsbuild.pants==2.5.0 (from versions: 0.0.17, 0.0.18, 0.0.20, 0.0.21, 0.0.22, 0.0.23, 0.0.24, 0.0.25, 0.0.26, 0.0.27, 0.0.28, 0.0.29, 0.0.30, 0.0.31, 0.0.32, 0.0.33, 0.0.34, 0.0.35, 0.0.36, 0.0.37, 0.0.38, 0.0.39, 0.0.40, 0.0.41, 0.0.42, 0.0.43, 0.0.44, 0.0.45, 0.0.46, 0.0.47, 0.0.48, 0.0.49, 0.0.50, 0.0.51, 0.0.52, 0.0.53, 0.0.54, 0.0.55, 0.0.56, 0.0.57, 0.0.58, 0.0.59, 0.0.60, 0.0.61, 0.0.62, 0.0.63, 0.0.64, 0.0.65, 0.0.66, 0.0.67, 0.0.68, 0.0.69, 0.0.70, 0.0.71, 0.0.72, 0.0.73, 0.0.74, 0.0.75, 0.0.76, 0.0.77, 0.0.79, 0.0.80, 0.0.81, 0.0.82, 1.0.0, 1.0.1, 1.1.0, 1.2.0, 1.2.1, 1.3.0, 1.4.0, 1.5.0, 1.6.0, 1.7.0, 1.15.0, 1.16.0, 1.17.0, 1.18.0, 1.19.0, 1.20.0, 1.21.0, 1.22.0, 1.23.0, 1.24.0, 1.25.0, 1.26.0, 1.27.0, 1.28.0)
ERROR: No matching distribution found for pantsbuild.pants==2.5.0

...myself and our DevOps lead could not duplicate with python 3.9.5 and 3.9.2 installed. Any idea what's happening here?

Hello everyone, quick question. I need pants to pull from a private pypi repo. I understand how to get the second repo initialized in the pants.toml file with

indexes.add = [<index>]

The part that I do not understand is how to get pants to see the authentication token for this repo. I am using pants 1.30 (I cannot update this repo at this time to a later version) Any guidance is appreciated here

https://twitter.com/glyph/status/1426414435275448324 Pants Build retweeted: I’ve often repeated this trope—python is the second best language—but one thing I haven’t always made clear is that… twitter.com/i/web/status/1… Twitter @techevangelista The old saying goes "Python is the second best language for everything". It might not be the fast… twitter.com/i/web/status/1… Twitter

https://twitter.com/theavalkyrie/status/1426414725437534209 Pants Build retweeted: @glyph Hell yeah. Python is also the best language for several domains: developer tooling, test automation, data sc… twitter.com/i/web/status/1… Twitter

Hey folks, is there a canonical way to set the version of pants I use in my CD pipelines? Presently I use the

PANTS_SHA

envvar but I'd like to target a semver range (eg,

^1.2.3

), is it possible?

https://twitter.com/glyph/status/1427077655627661315 Pants Build retweeted: The problem with “python packaging” is that the purpose of a “packaging” tool is to translate from a source format… twitter.com/i/web/status/1… Twitter

Interesting thread with implications for Pants 👆

I'm trying to get our build working on a co-workers Mac laptop. We're building with Python3.7:

[python-setup]
interpreter_constraints = ['CPython==3.7.*']

but when she runs the

pants

wrapper script she's getting an error that says `ProcessExecutionFailure: Process 'searching for

python2

...` . She does have various

python3

aliases set up via

pyenv

so I'm not sure why it's looking for Python2. In the error you can see that it ran

which -a python2

which fails because there is not

python2

on the

$PATH

. There is a

python2.7

which I could symlink but I'm wondering why it's looking for Python2 at all.

hm what's the failure say?

what's happening is that we use Pex to do interpreter discovery. But before that happens, we need to find a Python interpreter to run Pex itself: https://www.pantsbuild.org/docs/reference-pex#section-bootstrap-interpreter-names Pex works w/ Py27 and Py3, hence we consider if

python2

is there. But we shouldn't be failing. You can try changing that option, although definitely interested in the error

Here's the screen shot my colleague sent me:

do they have access to the bottom of that, the rest of stderr?

I can get it. I have a meeting with her a 2:30pm Pacific time today to try to get things working and get can that for you then.

Also, is this Pants v1?

2.4.0 according to stacktrace

yup, 2.4. Waiting on a bug fix to upgrade to 2.5.

Actually, just checked issues - looks like my bug was fixed and we can upgrade.

@hundreds-father-404 here's the full output:

15:23:51.60 [INFO] initializing scheduler...
15:23:52.68 [INFO] scheduler initialized.
15:23:53.07 [ERROR] Exception caught: (pants.engine.internals.scheduler.ExecutionError)
  File "/Users/ckolson/.cache/pants/setup/bootstrap-Darwin-x86_64/2.4.0_py38/lib/python3.8/site-packages/pants/bin/local_pants_runner.py", line 229, in _run_inner
    return self._perform_run(goals)
  File "/Users/ckolson/.cache/pants/setup/bootstrap-Darwin-x86_64/2.4.0_py38/lib/python3.8/site-packages/pants/bin/local_pants_runner.py", line 168, in _perform_run
    return self._perform_run_body(goals, poll=False)
  File "/Users/ckolson/.cache/pants/setup/bootstrap-Darwin-x86_64/2.4.0_py38/lib/python3.8/site-packages/pants/bin/local_pants_runner.py", line 185, in _perform_run_body
    return self.graph_session.run_goal_rules(
  File "/Users/ckolson/.cache/pants/setup/bootstrap-Darwin-x86_64/2.4.0_py38/lib/python3.8/site-packages/pants/init/engine_initializer.py", line 135, in run_goal_rules
    exit_code = self.scheduler_session.run_goal_rule(
  File "/Users/ckolson/.cache/pants/setup/bootstrap-Darwin-x86_64/2.4.0_py38/lib/python3.8/site-packages/pants/engine/internals/scheduler.py", line 530, in run_goal_rule
    self._raise_on_error([t for _, t in throws])
  File "/Users/ckolson/.cache/pants/setup/bootstrap-Darwin-x86_64/2.4.0_py38/lib/python3.8/site-packages/pants/engine/internals/scheduler.py", line 498, in _raise_on_error
    raise ExecutionError(
Exception message: 1 Exception encountered:
  ProcessExecutionFailure: Process 'Searching for `python2` on PATH=/Users/ckolson/.pyenv/versions/3.7.10/bin:/Users/ckolson/.pyenv/versions/3.8.9/bin:/Users/ckolson/code/env/bin:/Users/ckolson/google-cloud-sdk/bin:/Users/ckolson/.pyenv/shims:/Users/ckolson/.pyenv/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin' failed with exit code 1.
stdout:
stderr:
+ command -v which
+ command which -a python2
+ which -a python2
(Use --print-stacktrace to see more error details.)

Hm, what happens when you run

which -a python2

directly?

fyi this is the script being run:

set -euox pipefail

        if command -v which > /dev/null; then
            command which -a $1 || true
        else
            command -v $1 || true
        fi

I'm confused why the

|| true

isn't working... To debug, it may help to use `--no-process-execution-local-cleanup`: https://www.pantsbuild.org/v2.4/docs/troubleshooting#debug-tip-inspect-the-chroot-with---no-process-execution-local-cleanup

I'm afraid I don't have a Mac and the person who had this issue isn't available to help with this. But the ``bootstrap_interpreter_names` fix worked so we're not blocked anymore.

I'm not super familiar with the semantics of

set -e

but could that be the issue: a command did fail so maybe that takes precedence over the

|| true

?