apologies in advance for the random support question, but for whatever reason i’m not able to install the latest version of

pantsbuild.pants

. i’m on a clean M1 Pro macbook pro with barely anything installed so far (essentially just homebrew, pyenv, poetry, and python):

martim@Argon allpdl % poetry install
Installing dependencies from lock file

Package operations: 1 install, 0 updates, 0 removals

  • Installing pantsbuild.pants (2.7.0): Failed

  RuntimeError

  Unable to find installation candidates for pantsbuild.pants (2.7.0)

  at ~/.poetry/lib/poetry/installation/chooser.py:72 in choose_for
       68│ 
       69│             links.append(link)
       70│ 
       71│         if not links:
    →  72│             raise RuntimeError(
       73│                 "Unable to find installation candidates for {}".format(package)
       74│             )
       75│ 
       76│         # Get the best link

martim@Argon allpdl % ./pants -V
Bootstrapping Pants using /Users/martim/.pyenv/shims/python3
Installing pantsbuild.pants==2.7.0 into a virtual environment at /Users/martim/.cache/pants/setup/bootstrap-Darwin-arm64/2.7.0_py38
created virtual environment CPython3.8.10.final.0-64 in 140ms
  creator CPython3Posix(dest=/Users/martim/.cache/pants/setup/bootstrap-Darwin-arm64/pants.317fyy/install, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/Users/martim/Library/Application Support/virtualenv)
    added seed packages: pip==21.1.2, setuptools==57.0.0, wheel==0.36.2
  activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator
Requirement already satisfied: pip in /Users/martim/.cache/pants/setup/bootstrap-Darwin-arm64/pants.317fyy/install/lib/python3.8/site-packages (21.1.2)
Collecting pip
  Using cached pip-21.3.1-py3-none-any.whl (1.7 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 21.1.2
    Uninstalling pip-21.1.2:
      Successfully uninstalled pip-21.1.2
Successfully installed pip-21.3.1
ERROR: Could not find a version that satisfies the requirement pantsbuild.pants==2.7.0 (from versions: 0.0.17, 0.0.18, 0.0.20, 0.0.21, 0.0.22, 0.0.23, 0.0.24, 0.0.25, 0.0.26, 0.0.27, 0.0.28, 0.0.29, 0.0.30, 0.0.31, 0.0.32, 0.0.33, 0.0.34, 0.0.35, 0.0.36, 0.0.37, 0.0.38, 0.0.39, 0.0.40, 0.0.41, 0.0.42, 0.0.43, 0.0.44, 0.0.45, 0.0.46, 0.0.47, 0.0.48, 0.0.49, 0.0.50, 0.0.51, 0.0.52, 0.0.53, 0.0.54, 0.0.55, 0.0.56, 0.0.57, 0.0.58, 0.0.59, 0.0.60, 0.0.61, 0.0.62, 0.0.63, 0.0.64, 0.0.65, 0.0.66, 0.0.67, 0.0.68, 0.0.69, 0.0.70, 0.0.71, 0.0.72, 0.0.73, 0.0.74, 0.0.75, 0.0.76, 0.0.77, 0.0.79, 0.0.80, 0.0.81, 0.0.82, 1.0.0, 1.0.1, 1.1.0, 1.2.0, 1.2.1, 1.3.0, 1.4.0, 1.5.0, 1.6.0, 1.7.0)
ERROR: No matching distribution found for pantsbuild.pants==2.7.0

any clue what the issue might be? 😕

Hello, I've recently started using Pants. Everything worked perfect unitll I upgraded to macOS Monterey. Now when I try to run any pants command I get this:

15:46:09.41 [DEBUG] spawned local process as Some(99409) for Process { argv: ["/Users/sinisaderasevic/.pyenv/versions/3.9.7/bin/python", "./pex", "--python-path", "/Users/sinisaderasevic/.pyenv/versions/3.9.7/bin:/Users/sinisaderasevic/.virtualenvs/apollo/bin:/Users/sinisaderasevic/.pyenv/shims:/Users/sinisaderasevic/.pyenv/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin", "--tmpdir", ".tmp", "--interpreter-constraint", "CPython==3.9.*", "--", "-c", "import hashlib, os, sys\n\npython = os.path.realpath(sys.executable)\nprint(python)\n\nhasher = hashlib.sha256()\nwith open(python, \"rb\") as fp:\n  for chunk in iter(lambda: fp.read(8192), b\"\"):\n      hasher.update(chunk)\nprint(hasher.hexdigest())\n"], env: {"CPPFLAGS": "", "LC_CTYPE": "en_US.UTF-8", "LDFLAGS": "", "PATH": "/Users/sinisaderasevic/.virtualenvs/apollo/bin:/Users/sinisaderasevic/.pyenv/shims:/Users/sinisaderasevic/.pyenv/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin", "PEX_IGNORE_RCFILES": "true", "PEX_PYTHON_PATH": "/Users/sinisaderasevic/.pyenv/versions/3.9.7/bin:/Users/sinisaderasevic/.virtualenvs/apollo/bin:/Users/sinisaderasevic/.pyenv/shims:/Users/sinisaderasevic/.pyenv/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin", "PEX_ROOT": ".cache/pex_root"}, working_directory: None, input_files: Digest { hash: Fingerprint<26cf32db81511eab7e4996e09d5a21b162c66212333573648332b89025965ab8>, size_bytes: 158 }, output_files: {}, output_directories: {}, timeout: None, execution_slot_variable: None, description: "Find interpreter for constraints: CPython==3.9.*", level: Debug, append_only_caches: {CacheName("pex_root"): CacheDest(".cache/pex_root")}, jdk_home: None, platform_constraint: None, is_nailgunnable: false, cache_scope: PerRestartSuccessful }
15:46:09.80 [DEBUG] Completed: Find interpreter for constraints: CPython==3.9.*
15:46:09.80 [DEBUG] Completed: Scheduling: Find interpreter for constraints: CPython==3.9.*
15:46:09.80 [DEBUG] Completed: Find Python interpreter for constraints
15:46:09.80 [DEBUG] Completed: pants.backend.python.util_rules.pex.build_pex_component
15:46:09.80 [DEBUG] Completed: pants.backend.python.util_rules.pex.build_pex
15:46:09.80 [DEBUG] Completed: pants.backend.python.lint.black.rules.setup_black
15:46:09.80 [DEBUG] Completed: Format with Black
15:46:09.80 [DEBUG] Completed: `fmt` goal
15:46:09.80 [DEBUG] computed 1 nodes in 0.422410 seconds. there are 1501 total nodes.
15:46:09.80 [ERROR] Exception caught: (pants.engine.internals.scheduler.ExecutionError)
  File "/Users/sinisaderasevic/.cache/pants/setup/bootstrap-Darwin-arm64/2.7.0_py39/lib/python3.9/site-packages/pants/bin/local_pants_runner.py", line 236, in _run_inner
    return self._perform_run(goals)
  File "/Users/sinisaderasevic/.cache/pants/setup/bootstrap-Darwin-arm64/2.7.0_py39/lib/python3.9/site-packages/pants/bin/local_pants_runner.py", line 175, in _perform_run
    return self._perform_run_body(goals, poll=False)
  File "/Users/sinisaderasevic/.cache/pants/setup/bootstrap-Darwin-arm64/2.7.0_py39/lib/python3.9/site-packages/pants/bin/local_pants_runner.py", line 192, in _perform_run_body
    return self.graph_session.run_goal_rules(
  File "/Users/sinisaderasevic/.cache/pants/setup/bootstrap-Darwin-arm64/2.7.0_py39/lib/python3.9/site-packages/pants/init/engine_initializer.py", line 135, in run_goal_rules
    exit_code = self.scheduler_session.run_goal_rule(
  File "/Users/sinisaderasevic/.cache/pants/setup/bootstrap-Darwin-arm64/2.7.0_py39/lib/python3.9/site-packages/pants/engine/internals/scheduler.py", line 538, in run_goal_rule
    self._raise_on_error([t for _, t in throws])
  File "/Users/sinisaderasevic/.cache/pants/setup/bootstrap-Darwin-arm64/2.7.0_py39/lib/python3.9/site-packages/pants/engine/internals/scheduler.py", line 506, in _raise_on_error
    raise ExecutionError(

Exception message: 1 Exception encountered:

  ProcessExecutionFailure: Process 'Find interpreter for constraints: CPython==3.9.*' failed with exit code 1.
stdout:

stderr:
Traceback (most recent call last):
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.bootstrap/pex/pex.py", line 483, in execute
    exit_value = self._wrap_coverage(self._wrap_profiling, self._execute)
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.bootstrap/pex/pex.py", line 401, in _wrap_coverage
    return runner(*args)
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.bootstrap/pex/pex.py", line 432, in _wrap_profiling
    return runner(*args)
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.bootstrap/pex/pex.py", line 539, in _execute
    return self.execute_entry(self._pex_info.entry_point)
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.bootstrap/pex/pex.py", line 655, in execute_entry
    return self.execute_pkg_resources(entry_point)
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.bootstrap/pex/pex.py", line 687, in execute_pkg_resources
    return runner()
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/bin/pex.py", line 1149, in main
    pex_builder = build_pex(options.requirements, options, cache=ENV.PEX_ROOT)
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/bin/pex.py", line 895, in build_pex
    interpreters = list(
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/pex_bootstrapper.py", line 139, in iter_compatible_interpreters
    for interpreter_or_error in _iter_interpreters():
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/pex_bootstrapper.py", line 104, in _iter_interpreters
    for interp in PythonInterpreter.iter_candidates(
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/interpreter.py", line 570, in iter_candidates
    for interpreter in cls._filter(iter_interpreters()):
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/interpreter.py", line 922, in _filter
    for interp in pythons:
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/interpreter.py", line 551, in iter_interpreters
    for candidate in cls._find(
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/jobs.py", line 431, in execute_parallel
    yield spawn_result.spawned_job.await_result()
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/jobs.py", line 220, in await_result
    return result_func(stdout)
  File "/Users/sinisaderasevic/bull/apollo/.cache/pants/named_caches/pex_root/unzipped_pexes/592827b562c4aa09c1e9af6b3ed7b797eef1a4dc/.deps/pex-2.1.44-py2.py3-none-any.whl/pex/interpreter.py", line 667, in create_interpreter
    raise cls.IdentificationError("Could not establish identity of {}.".format(binary))
pex.interpreter.IdentificationError: Could not establish identity of /System/Library/Frameworks/Python.framework/Versions/2.7/Resources/pythonwrapper.app/Contents/MacOS/pythonwrapper.

Any help would be appreciated. Thanks

is there a way to turn off the python-dependency-discovery? It just doesn't feel like it works that great. I'm adding

//3rdparty:xyz

to my dependencies more often than not. at the point I want to just make it explicit.

Hi there, I am currently evaluating to move to Pants for one of our Teams’ Multi/Monorepositories, where we currently use a poetry setup (with a lot of small scripts to make it work). It looks very promising so far and setting it up for automated tasks & artefact building was really easy. However, when I was looking into setting up VS Code (which most of us use) I am struggling a bit. Right now we install the needed first party packages es editable installs into multiple venvs (which correspond to different sets of lock files). There are multiple problems, for which I am not sure if there would be better approaches: • The code completion works best if all first party module paths are added as an extraPaths settings (which is read from a settings.json). For now I think it’s easiest if I use the output of

./pants roots

as every root in my setup corresponds to one top level module in the python module hierarchy. I guess this process can be easily automated and I assume there is no better solution here (and it’s not that bad with this setup, actually it’s better than what we had with poetry). • For multiple lock files, we can work around this for now and looking at the docs it seems there will be support for this soon, which is great 🎉! • Most headaches come from my tries to debug and run code from within VSCode. The setup with editable install works great with poetry as it easily allows to launch binaries / cli scripts from within VSCode with a debugger attached. As the files executed are the ones edited, there are no problems with source mapping and breakpoints set in VSCode are respected when running. For this VSCode uses debugpy (https://github.com/microsoft/debugpy). Executables are specified in a

launch.json

file (https://code.visualstudio.com/docs/python/debugging) and then it is possible to run them from the UI. ◦ I managed to debug a running pex file where I attach to a remote debugger manually started in the code. This is cool, but still a bit inconvenient as breakpoints are not working and it requires more boilerplate work. ◦ I also manage to run a pex file with the debugpy launcher, but then it ignores exceptions and does not enter the debugger (it seems some subprocess / fork is not covered by the debugger). ◦ Even with that I would need to do source mapping as the pex venv is located elsewhere and has some (possibly outdated) copies. ◦ One idea I had was a plugin that creates a venv where all source roots are installed editable. But not sure if there is an easier solution?

Another observation I made on 2.7 is that when I add a

poetry_requirements()

and have a constraints file the

./pants repl

fails with an error message:

❯ ./pants repl components/grp_a/cmp_a
09:31:57.27 [INFO] Initializing scheduler...
09:31:57.63 [INFO] Scheduler initialized.
Traceback (most recent call last):
  File "/Users/malte/src/pants-eval/.pants.d/tmpw7g1gbql/requirements.pex/.bootstrap/pex/pex.py", line 482, in execute
  File "/Users/malte/src/pants-eval/.pants.d/tmpw7g1gbql/requirements.pex/.bootstrap/pex/pex.py", line 139, in activate
  File "/Users/malte/src/pants-eval/.pants.d/tmpw7g1gbql/requirements.pex/.bootstrap/pex/pex.py", line 125, in _activate
  File "/Users/malte/src/pants-eval/.pants.d/tmpw7g1gbql/requirements.pex/.bootstrap/pex/pex.py", line 109, in _loaded_envs
  File "/Users/malte/src/pants-eval/.pants.d/tmpw7g1gbql/requirements.pex/.bootstrap/pex/pex_info.py", line 103, in from_pex
FileNotFoundError: [Errno 2] No such file or directory: '__reqs/rich<11.0.0,>=10.11.0.pex/PEX-INFO'

I searched the issue tracker, but couldn’t find an issue for it. I will test this later with 2.8beta, but maybe this is some obvious thing I missed?

Thank you 🙂 This worked 💥

Thanks for getting back. We could improve the experience here by looking at what you were trying to copy, and find a solution for it as a suggested course of action in the error message. 🤔

Another "hm, that's odd"; pants 2.6, Arch, Python 3.9...

Exception message: 1 Exception encountered:

  BinaryNotFoundError: Cannot find `unzip` on `['/bin', '/usr/bin', '/usr/local/bin']`. Please ensure that it is installed so that Pants can download the tools Pants needs to run.



(Use --print-stacktrace for more error details and/or --no-process-execution-local-cleanup to inspect chroots and/or -ldebug for more logs. See <https://www.pantsbuild.org/v2.6/docs/troubleshooting> for common issues. Consider reaching out for help: <https://www.pantsbuild.org/v2.6/docs/getting-help.>)
[arch@ip-172-31-76-241 forge]$ which unzip
/usr/bin/unzip

I feel I'm missing something obvious 🙂

(this was a

pants test ::

invocation)

And I should add that

unzip

appears to be working fine. I did search but no one else seems to have trouble with unzip existing 😞

Actually even stranger, executing with

--no-process-execution-local-cleanup

seems to be running.

hey team, I am seeing Pants giving me errors when I use version

2.7.0

or

2.7.1

instead of

2.6.1

. It may be related to https://pantsbuild.slack.com/archives/C046T6T9U/p1634120386065100?thread_ts=1634114532.062500&cid=C046T6T9U.

https://twitter.com/fullstackpython/status/1454545151901175818 Pants Build retweeted: Streamline your Docker builds with Pants https://blog.pantsbuild.org/pants-pex-and-docker/ Twitter

https://twitter.com/pantsbuild/status/1455286037832474633 We may be slightly biased, but we gotta give this the prize for Cutest Costume. We look forward to welcoming you into the Pants Build community in a couple decades, kiddo! Twitter I just want everyone to know that my two-year old insisted on being “pants” for Halloween... Twitter

Is there any way to have pants write the results of shellcheck and shfmt to a file rather than stdout? I don't think either of those tools have a native option for doing so, and parsing structure results out of the pants output seems a bit tricky.

Another lint-related question. When I try to run

./pants lint ::

I get

Error launching process: Os { code: 7, kind: Other, message: "Argument list too long" }

. It seems that pants is trying to run black and isort on all the files in my repo with one invocation.

https://twitter.com/luca_cloud/status/1447965024031494144 Pants Build retweeted: WTF is platform engineering?! Come find out. We just launched a new slack space for everyone interested in nerding… https://twitter.com/i/web/status/1447965024031494144 Twitter

https://twitter.com/rustlang/status/1454963732484870144 Pants Build retweeted: We have a security advisory for rustc today: https://blog.rust-lang.org/2021/11/01/cve-2021-42574.html We will have a 1.56.1 release out soon. Twitter

https://twitter.com/rustlang/status/1455143192358268928 Pants Build retweeted: Rust 1.56.1 is now out, featuring new lints to mitigate the impact of CVE-2021-42574. https://blog.rust-lang.org/2021/11/01/Rust-1.56.1.html Twitter

https://twitter.com/simonw/status/1454983681454477317 Pants Build retweeted: This is nasty: use Unicode tricks like changing the text decoration to add invisible security vulnerabilities in a… https://twitter.com/i/web/status/1454983681454477317 Twitter The Trojan Source vulnerability allows supply-chain attacks on software written in C, C++, Go, Java, Javascript, Py… https://twitter.com/i/web/status/1454962928923418626 Twitter

Another question for my evaluation: In the python test section (https://www.pantsbuild.org/v2.8/docs/python-test-goal) it is written, that

./pants test ::

only reruns tests needed if I change e.g. a single file. This would then also be true on CI with a cache enabled right? So if I want up to date coverage on the main branch, I would need to remove the test result cache (

$HOME/.cache/pants/lmdb_store

) on the main branch so that all tests run? Right now we have some grouping of modules into clearly seperated dependency groups and to save time on the main branch we only run the tests for groups that are changed and then combine coverage to save a bit of execution time on the main branch), would this also be possible with pants?

When I set "PANTS_CONFIG_FILE", that will always be additive to pants.toml, right? Just making sure I'm reading the docs right before I go push someone else down a rabbit hole 😁

What is the workaround for the MacOS Monterey bad interpreter issue, until we get that fix backported?

is there any way to set multiple pyproject.toml files in a single repo? We currently have a setup like this and I would like to find a way to get pants working alongside our current build

Hi! Do you have reference/recommendation on companies that build products to help measure devops efficiency. For example how long it takes from code to deploy artifact etc?

https://twitter.com/pantsbuild/status/1455596122165194753 Relatable. v2.0 was massive change ;-) A year later, though, we're still really glad we took the gamble of starting over from scratch to create a cutting-edge build system that truly supports modern software engineering priorities and practices. Twitter I don’t understand pants anymore more. I’m having to revise my whole notion of pants and I don’t know where to start. Is it just me Twitter

https://twitter.com/pantsbuild/status/1452679045272031244 Pants Build retweeted: “Pants Build Open Source Community Newsletter - Issue #1” http://newsletter.pantsbuild.org/archive/823407 Twitter

We've moved the Twitter bot from #general to #random. If you like to follow the account via Slack instead of a Twitter client, be sure to join #random! 🐦