npx is a bit weird (as is npm exec in my opinion).

It maintains its own cache and looks for local node_modules wherever it can. So, npx cowsay will ask to install 1.5.0 - but if I want to lock that to using a lockfile, I need to do npm install cowsay (generates package-lock.json) and then npx cowsay will use that local version in the node_modules.

So, lockfiles == good, but a bit of work here, unless there is an npx input to use a lockfile directly - but I just ran some tests that didn't work, nor can I find any docs on this subject right now.

experimental_shell_command

outputs

experimental_shell_command

BUILD

src

relocated_files

strip_prefix

experimental_shell_command

<PWD>

src

dest

build_file_dir()

relocated_files

$ ./pants help PANTS_EXPORT_SYMLINK_PYTHON_VIRTUALENV
Unknown entity: PANTS_EXPORT_SYMLINK_PYTHON_VIRTUALENV

[export].symlink_python_virtualenv

./pants lint ::

./pants check ::

--changed-since

./pants test

--shard=k/N

lint

check

fix

fmt

lint

--shard

./pants list

python_awslambda

pex3 interpreter inspect --markers --tags

"cp39-cp39-manylinux_2_26_x86_64"

manylinux_2_28

...
pex: Unresolved requirements:
pex:   - cryptography>=3.4.0; extra == "cryptography"
pex: Distributions contained within this pex:
...
pex:   - cryptography-38.0.3-cp36-abi3-manylinux_2_28_x86_64.whl
...
Failed to import module 'lambdex_handler': Failed to resolve requirements from PEX environment @ /var/task.
Needed cp39-cp39-manylinux_2_26_x86_64 compatible dependencies for:
 1: cryptography>=3.4.0; extra == "cryptography"
    Required by:
      python-jose 3.3.0
    But this pex had no ProjectName(raw='cryptography', normalized='cryptography') distributions.
...

git clone <https://gist.github.com/504ef2a5d44efdc2c2df290c0ce5df16.git> && cd 504ef2a5d44efdc2c2df290c0ce5df16 && ./pants package :lambda && unzip -p dist/lambda.zip PEX-INFO | jq .

distributions

cryptography

cryptography-38.0.3-cp36-abi3-manylinux_2_24_x86_64.whl

cryptography-38.0.3-cp36-abi3-manylinux_2_28_x86_64.whl

ubuntu-latest

actions/setup-python@v4

python-version: 3.9

complete_platform

uname -ms 
# Darwin arm64

docker pull --platform linux/amd64 python@sha256:c1613835d7be322f98603f356b9e0c9d40f9589e94dc9f710e714a807a665700  # 3.9 at the time of writing
# ...

docker run -t --platform linux/amd64 python@sha256:c1613835d7be322f98603f356b9e0c9d40f9589e94dc9f710e714a807a665700 bash -c 'echo -e "[GLOBAL]\npants_version = \"2.14.0\"" > pants.toml && curl -L -O <https://static.pantsbuild.org/setup/pants> && chmod +x ./pants && ./pants -ldebug --no-pantsd --no-watch-filesystem  version'
# ...
# Bootstrapping Pants using /usr/local/bin/python3.9
# ...
# New virtual environment successfully created at /root/.cache/pants/setup/bootstrap-Linux-x86_64/2.14.0_py39.
# 22:53:01.00 [DEBUG] File handle limit is: 1048576
# 22:53:03.05 [DEBUG] Using [cache::CommandRunner { inner: bounded::CommandRunner { inner: nailgun::CommandRunner { inner: local::CommandRunner { .. }, .. }, .. }, .. }, cache::CommandRunner { inner: bounded::CommandRunner { inner: nailgun::CommandRunner { inner: local::CommandRunner { .. }, .. }, .. }, .. }] for process execution.
# 22:53:04.12 [DEBUG] Launching 1 roots (poll=false).
# 22:53:04.26 [DEBUG] computed 1 nodes in 0.136536 seconds. there are 7 total nodes.
# 22:53:04.51 [DEBUG] File handle limit is: 1048576
# 22:53:06.61 [DEBUG] Using [cache::CommandRunner { inner: bounded::CommandRunner { inner: nailgun::CommandRunner { inner: local::CommandRunner { .. }, .. }, .. }, .. }, cache::CommandRunner { inner: bounded::CommandRunner { inner: nailgun::CommandRunner { inner: local::CommandRunner { .. }, .. }, .. }, .. }] for process execution.
# 22:53:06.83 [DEBUG] specs are: Specs(includes=RawSpecs(description_of_origin='CLI arguments', address_literals=(), file_literals=(), file_globs=(), dir_literals=(), dir_globs=(), recursive_globs=(), ancestor_globs=(), unmatched_glob_behavior=<GlobMatchErrorBehavior.error: 'error'>, filter_by_global_options=True, from_change_detection=False), ignores=RawSpecs(description_of_origin='CLI arguments', address_literals=(), file_literals=(), file_globs=(), dir_literals=(), dir_globs=(), recursive_globs=(), ancestor_globs=(), unmatched_glob_behavior=<GlobMatchErrorBehavior.error: 'error'>, filter_by_global_options=False, from_change_detection=False))
# 22:53:06.83 [DEBUG] changed_options are: ChangedOptions(since=None, diffspec=None, dependees=<DependeesOption.NONE: 'none'>)
# 22:53:06.83 [DEBUG] Launching 1 roots (poll=false).
# 22:53:06.85 [WARN] Please either set `enabled = true` in the [anonymous-telemetry] section of pants.toml to enable sending anonymous stats to the Pants project to aid development, or set `enabled = false` to disable it. No telemetry sent for this run. An explicit setting will get rid of this message. See <https://www.pantsbuild.org/v2.14/docs/anonymous-telemetry> for details.
# 22:53:06.86 [DEBUG] computed 1 nodes in 0.024304 seconds. there are 12 total nodes.
# 2.14.0

--no-pantsd --no-watch-filesystem

docker ps

docker exec -t ...name... top

File handle limit is: 1048576

22:53:04.51

A docker_image can depend on loose files belonging to file / files targets, and on artifacts packaged from a variety of targets, such as pex_binary , python_distribution, archive, or any other target that can be built via the package goal.

./pants

./pants package

There was 1 error downloading required artifacts:artifacts
1. clr 0.3.19 from git+<https://github.com/color/clr.git@a444a0612374a19f22e511b5e3514a60561e6160>
    Expected sha256 hash of 88c4fc49003c1594d70aefe9cfbae3e60327a85e52e4608755f52cce2d438eb3 when downloading clr but hashed to 39cdfcc1e1980477476434e6d3d7777bc2bbecff7fcd903f36b4ddb1b17283a5.

$ curl -sSL <https://github.com/pantsbuild/pex/releases/download/v2.1.114/pex> -O
$ PEX_SCRIPT=pex3 python3.7 pex lock create --style universal --target-system linux --target-system mac --resolver-version pip-2020-resolver "git+<https://githu/>
b.com/color/clr.git@a444a0612374a19f22e511b5e3514a60561e6160#egg=clr" --indent 2 -o lock.3.7.json
$ PEX_SCRIPT=pex3 python3.8 pex lock create --style universal --target-system linux --target-system mac --resolver-version pip-2020-resolver "git+<https://github.com/color/clr.git@a444a0612374a19f22e511b5e3514a60561e6160#egg=clr>" --indent 2 -o lock.3.8.json
$ PEX_SCRIPT=pex3 python3.9 pex lock create --style universal --target-system linux --target-system mac --resolver-version pip-2020-resolver "git+<https://github.com/color/clr.git@a444a0612374a19f22e511b5e3514a60561e6160#egg=clr>" --indent 2 -o lock.3.9.json
$ diff lock.3.7.json lock.3.8.json
52c52
<               "hash": "39be551f54bc4c59210f08326bc649806d0ca18b8c008975424023cda2568782",
---
>               "hash": "88c4fc49003c1594d70aefe9cfbae3e60327a85e52e4608755f52cce2d438eb3",
$ diff lock.3.7.json lock.3.9.json
52c52
<               "hash": "39be551f54bc4c59210f08326bc649806d0ca18b8c008975424023cda2568782",
---
>               "hash": "39cdfcc1e1980477476434e6d3d7777bc2bbecff7fcd903f36b4ddb1b17283a5",

./pants generate-lockfiles

package

generate-lockfiles

package

$(which python) ./pex --lock <lockfile> <requirement>...

<lockfile>

generate-lockfiles

./pants package

generate-lockfiles

setup-requires

setup.py

.pants.bootstrap

./pants

# .pants.bootstrap

# Ensure GIT_COMMIT is set
: ${GIT_COMMIT:=$(git rev-parse HEAD)}

# ...

./pants

./pants

visibility

$ wget <https://github.com/pantsbuild/pex/releases/download/v2.1.108/pex>
$ PEX_PYTHON=/usr/bin/pypy3.8 /usr/bin/pypy3.8 ./pex -V              
2.1.108

$ wget <https://github.com/pantsbuild/pex/releases/download/v2.1.109/pex>
$ PEX_PYTHON=/usr/bin/pypy3.8 /usr/bin/pypy3.8 ./pex -V
Failed to find a compatible PEX_PYTHON=/usr/bin/pypy3.8.

Examined the following interpreters:
1.) /usr/bin/pypy3.8 PyPy==3.8.13

No interpreter compatible with the requested constraints was found:

  Version matches CPython!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*,!=3.4.*,<3.12,>=2.7

--resolve-local-platforms

--platform

--platform

--complete-platform

--platform

--complete-platform

23:45:02.29 [ERROR] Completed: Run Pytest - src/python/pants/core/goals/fix_test.py:tests - failed (exit code 1).
============================= test session starts ==============================
collecting ... collected 12 items

src/python/pants/core/goals/fix_test.py::test_summary PASSED             [  8%]
src/python/pants/core/goals/fix_test.py::test_skip_formatters PASSED     [ 16%]
src/python/pants/core/goals/fix_test.py::test_fixers_first FAILED        [ 25%]
src/python/pants/core/goals/fix_test.py::test_only PASSED                [ 33%]
src/python/pants/core/goals/fix_test.py::test_no_targets PASSED          [ 41%]
src/python/pants/core/goals/fix_test.py::test_message_lists_added_files PASSED [ 50%]
src/python/pants/core/goals/fix_test.py::test_message_lists_removed_files PASSED [ 58%]
src/python/pants/core/goals/fix_test.py::test_message_lists_files PASSED [ 66%]
src/python/pants/core/goals/fix_test.py::test_default_single_partition_partitioner[KitchenSingleUtensilFieldSet-field_sets0] PASSED [ 75%]
src/python/pants/core/goals/fix_test.py::test_default_single_partition_partitioner[KitchenMultipleUtensilsFieldSet-field_sets1] PASSED [ 83%]
src/python/pants/core/goals/fix_test.py::test_streaming_output_changed PASSED [ 91%]
src/python/pants/core/goals/fix_test.py::test_streaming_output_not_changed PASSED [100%]

=================================== FAILURES ===================================
______________________________ test_fixers_first _______________________________

    def test_fixers_first() -> None:
        rule_runner = fix_rule_runner(
            target_types=[FortranTarget, SmalltalkTarget],
            # NB: Order is important here
            request_types=[FortranFmtRequest, FortranFixRequest],
        )
    
        write_files(rule_runner)
    
        stderr = run_fix(rule_runner, target_specs=["::"])
    
        # NB Since both rules have the same body, if the fixer runs first, it'll make changes. Then the
        # formatter will have nothing to change.
>       assert stderr == dedent(
            """\
    
            + FortranConditionallyDidChange made changes.
            ✓ FortranFormatter made no changes.
            """
        )
E       AssertionError: assert equals failed
E         '\n+ FortranConditionallyDidCha  '\n+ FortranConditionallyDidCha 
E         nge made changes.\n✓ FortranFor  nge made changes.\n✓ FortranFor 
E         matter made no changes.\n\n✓ Fo  matter made no changes.\n'      
E         rtranConditionallyDidChange mad                                  
E         e no changes.\n✓ FortranFormatt                                  
E         er made no changes.\n'

src/python/pants/core/goals/fix_test.py:342: AssertionError
- generated xml file: /tmp/pants-sandbox-oaXEIM/src.python.pants.core.goals.fix_test.py.tests.xml -


=========================== short test summary info ============================
FAILED src/python/pants/core/goals/fix_test.py::test_fixers_first - Assertion...
========================= 1 failed, 11 passed in 4.06s =========================

.pants.d/pants.log

06:50:26.74 [INFO] notify invalidation: cleared 1 and dirtied 26 nodes for: {"", "ignored_dir"}
06:50:26.74 [INFO] notify invalidation: cleared 1 and dirtied 5192 nodes for: {"ignored_dir", ""}

pants_ignore

-msan

COPY --from=<BASEIMAGE> <FILES>

failed to compute cache key: <FILES>.

-asan

./pants test ::

[ERROR] Completed: Compile with Go - <redacted> failed (exit code 1).

echo $?

import-linter

ValidatedDependencies

ValidateDependenciesRequest

ValidatedDependencies

Result

regex-lint

project_info

$ curl -sSL <https://files.pythonhosted.org/packages/26/b4/356748c06781caabbc8f17d71b69a06a0efe14dd63dd199b9c29d1dbc85f/pantsbuild.pants-2.16.0.dev1-cp39-cp39-manylinux2014_x86_64.whl> -O
$ unzip -qc pantsbuild.pants-2.16.0.dev1-cp39-cp39-manylinux2014_x86_64.whl pantsbuild.pants-2.16.0.dev1.dist-info/METADATA | grep -E "^Version:"
Version: 2.16.0.dev1
$ unzip -qc pantsbuild.pants-2.16.0.dev1-cp39-cp39-manylinux2014_x86_64.whl pants/_version/VERSION
2.16.0.dev1+git57fecb6c

$ zipinfo pantsbuild.pants-2.16.0.dev1-cp39-cp39-manylinux2014_x86_64.whl | grep -E "pants/(_version|version)"
-rw-r--r--  2.0 unx     1310 b- defN 22-Nov-27 18:01 pants/version.py
-rw-r--r--  2.0 unx       23 b- defN 22-Nov-27 18:01 pants/_version/VERSION
-rw-r--r--  2.0 unx        0 b- defN 22-Nov-27 18:01 pants/_version/__init__.py

extra_globs

./pants package ::

BUILD

build

pyproject.toml

resource(name="pyproject", source="pyproject.toml")

python_distribution(
    name="dist",
    dependencies=[
        ":pyproject"
    ],
    provides=python_artifact(
        name="example_package",
        version="0.0.1",
    ),
    generate_setup=False
)

python_sources()

[build-system]
requires = ["setuptools", "setuptools-scm", "wheel"]
build-backend = "setuptools.build_meta"

[project]
name = "example_package"
version = "0.0.1"
description = "description"
authors = [{name = "example"}]
keywords = ["example"]
requires-python = ">=3.11"
license = {text = "Apache License 2.0"}
classifiers = [
    "Development Status :: 2 - Pre-Alpha"
]
dependencies = [
    "requests==2.28.1"
]

[tool.setuptools]
include-package-data = true

[tool.setuptools.packages.find]
exclude=["tests*"]

.
├── BUILD
├── <http://MANIFEST.in|MANIFEST.in>
├── NOTICE
├── README.md
├── pyproject.toml
├── example_package
│   ├── BUILD
│   ├── __init__.py
│   ├── py.typed
│   └── example.py
└── tests
    ├── __init__.py
    └── unit
        ├── BUILD
        ├── __init__.py
        └── test_example.py

example_package-0.0.1
├── PKG-INFO
├── backend_shim.py
├── pyproject.toml
├── setup.cfg
└── example_package.egg-info
    ├── PKG-INFO
    ├── SOURCES.txt
    ├── dependency_links.txt
    ├── requires.txt
    └── top_level.txt

backend_shim.py