Hello all! I’m hitting an interesting problem that isn’t making much sense to me. I’ve got a unit test setup using pytest-tornado following the directions in their README.md and all works perfectly fine running through pipenv. When I put pants on it though, anything written synchronously works and tests with

async

in front claim they can’t find fixtures. I’ve got a much larger project already using tornado so re-writing without async is not currently feasible, hoping this simplified example sparks something in someone. I’ve got a sample project here with instructions on how to reproduce the issue

solution https://pantsbuild.slack.com/archives/C046T6T9U/p1673386507138299?thread_ts=1673367823.361639&cid=C046T6T9U

Im running into a weird problem trying to

package

a

docker_image

target within a github action. It's telling me that it cant connect to docker:

Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?.

Whats weird is that if in the same step i do

docker build .

to the same dockerfile pants points to in

docker_image

, it works properly and builds all layers except the ones using the pants context (i.e

foo.bar/main.pex

)

Hi team, from time to time, when I run

./pants check

command, mypy is complaining error from third-party library. Below is an example. Sometimes it goes away after re-running the command or cleaning the cache. It is annoying, any insight or suggestion?

[2023-01-02T16:05:59.896Z] .cache/pex_root/venvs/0cbc48e25cc767e871f34f3472936b3851b41d9c/bf77cd40798e75deda6009f40e4c437c9e3474cf/lib/python3.9/site-packages/torch/fx/experimental/symbolic_shapes.py:14:1: error: Cannot find implementation or library stub for module named "sympy"  [import]
[2023-01-02T16:05:59.896Z]         import sympy  # type: ignore[import]
[2023-01-02T16:05:59.896Z]     ^
[2023-01-02T16:05:59.896Z] test/unit/atom_fm/fm/pipeline/data/test_create_coarse_features_dataset.py:6: note: In module imported here:
[2023-01-02T16:05:59.897Z] .cache/pex_root/venvs/0cbc48e25cc767e871f34f3472936b3851b41d9c/bf77cd40798e75deda6009f40e4c437c9e3474cf/lib/python3.9/site-packages/xarray/__init__.py:43:1: error: Cannot find implementation or library stub for module named "importlib_metadata"  [import]
[2023-01-02T16:05:59.897Z]         from importlib_metadata import version as _version  # type: ignore[no-redef]
[2023-01-02T16:05:59.897Z]     ^

Hi again, am trying to introduce pants slowly to an existing project and have set up separate folder structure to help with moving of the files over. have set up a basic hello world file and test but getting the following error when I run

./pants test ::

./pants test ::  
08:44:38.18 [WARN] Failed to generate JUnit XML data for lambdas/hello_world/tests/test_hello_world.py.
08:44:38.18 [ERROR] Completed: Run Pytest - lambdas/hello_world/tests/test_hello_world.py failed (exit code 4).
ERROR: usage: pex [options] [file_or_dir] [file_or_dir] [...]
pex: error: unrecognized arguments: --report-skipped=
  inifile: /tmp/pants-sandbox-q5Tr08/tox.ini
  rootdir: /tmp/pants-sandbox-q5Tr08

Hi all. I’m trying to understand if it is normal for pex to leave /tmp/ folders behind after execution. If there is a configuration that I can use to manage that behavior. And if that is not the expected behavior, where should I start troubleshooting this. If there is some documentation section that I should be reading for context, please feel free to point that out. Thanks for any help.

How did you install Python 3.8 or Python 3.9 on Ubuntu 22.04 to bootstrap Pants Here is my solution: https://github.com/pantsbuild/pants/issues/17962

Hi, general question about `pants`/`pex`. Is there an easy way of building a pex_binary containing tests (written using pytest) that executes the tests when the binary is run. The plan is to use this binary to run integration tests on different environments during CI. My solution so far is to add a small

main.py

shim to call

pytest.main()

on the tests within the pex. Thank you very much in advance for any guidance on this topic!

Hello Everyone ! I’m a devops engineer not familliar with Pants. I’m trying to allow Pants working with a SOCKS5 proxy to connect to a private python repository. • I followed the documentation here and pushed the environment variable required. Everything is working as expected, however I need to get

pysocks

library in the

venv used by Pants

(likely here

/home/circleci/.cache/pants/setup/bootstrap-Linux-x86_64/2.14.0_py38/lib/python3.8/site-packages

) Pip needs that library to retrieve packages, hence I have the error.

Looking in indexes: <https://pypi.org/simple/>, <https://admin>:****@python-index.xxxxx.fr/simple/
  ERROR: Could not install packages due to an EnvironmentError: Missing dependencies for SOCKS support.

I installed

pysocks

at system venv (with pip), this is working as expected, but not while running Pants. ➡️ Can you tell me how I can add a library to the venv used by pants ? Thank you very much for your help.

👋 I’m new to Pants and trying to address a security issue that was first detected in a PEX binary we use to run a Python web application. The PEX binary was built with Pants

2.7

. I think that our security scanner detected a version of the Python

wheel

in package in the PEX application binary with the security vulnerability… apparently all versions of

wheel

below

0.38.1

have this vulnerability. When I built the PEX binary with Pants

2.7

:

wheel

version

0.36.2

was detected. When I built the PEX binary with Pants

2.14

:

wheel

version

0.37.1

was detected. I changed as little as possible in the Python application and configuration when upgrading the Pants versions (but I did have to make some small changes as a result of the API / CLI changes between the two Pants versions). I’m reasonably certain that the increase in

wheel

version was due to the Pants upgrade, having gone to some pains to rule out other factors. My question is: is there any way I can ask Pants to embed a newer version of the

wheel

package that replaces these older versions in the

PEX

binary? Is there any other information I could give that would help shed any more light on this issue? Thanks in advance for taking a gander!

Hey there! Quick question concerning the Targets

resources

I would like to include all

*.html

in multiple projects. I am just not sure of the syntax to specify any folder under the project root Giving this structure • Project A ◦ Folder A ▪︎ file.html ◦ Folder B ▪︎ Folder B.1 • file.html ◦ BUILD Can I include only this in the BUILD at the root of every projects ?

python_sources(
    dependencies=[":static-files"],
)

resources(
    name="static-files",
    sources=["**/*.html"]
)

Thanks in advance 🙂

Hi, I tried Pants for our use case of CKAN development. CKAN’s only supported on Ubuntu, so we need to run it in Docker. For development, we run Docker compose and mount our source code in the image and enable server reload on source code changes. I’d like to use a tool like Pants to handle the Docker Compose context (i.e. pull in code from outside docker-compose.yml directory). It doesn’t seem like a current use case for Pants. Any suggestions?

Having a strange problem building a distribution for a Lambda function where the function is dying because the PEX doesn't have required dependencies. Here's my `BUILD`:

docker_image(
    name="create_json_image",
    repository="repo",
    dependencies=[":create_json_lambda"],
    image_tags=["tag"],
)

python_awslambda(
    name="create_json_lambda",
    runtime="python3.8",
    handler="lambda_function.py:lambda_handler",
)

python_sources(
    dependencies=[
        "src/vendor/python:reqs#pkg1",
        "src/vendor/python:reqs#pkg2",
    ]
)

And then the Lambda itself gives me errors like:

[ERROR] ResolveError: Failed to resolve requirements from PEX environment @ /app.
Needed cp38-cp38-manylinux_2_26_x86_64 compatible dependencies for:
1: Pillow>=8.1.1
Required by:
pkg2
But this pex had no ProjectName(raw='Pillow', normalized='pillow') distributions.

(with lots of other un-available packages). Is this a problem with Lambdex? Pants has always been so great at avoiding dependency errors!

Is there an example repo with multiple python packages which each have individual tests? something like the below for structure package1 package1 tests readme.md

Hey Pants Team, curious if there's a way we can retrieve granular runtimes from the lint goal. For example, if we run `flake8`/`isort` on lint we want to know the total runtime for each lint tool

I’m trying to get my head around caching with Gitlab CI rather than Github - I was hoping someone had an example I could crib from since following the documentation makes me feel like I’m a bit hamstrung

Im having an issue where pants is properly compiling my proto files to python sources, they show up correctly whne i do export-codegen, but it cant infer them later when i try to

package

a pex binary, do i have to do anything special to make pants know that

import my_proto_source

?

{build_args.REGISTRY}/$stg/$ecr_repository:$IMAGE_TAG +1 additional tag.
Error: 5.45 [ERROR] 1 Exception encountered:

  ProcessExecutionFailure: Process 'Building docker image {build_args.REGISTRY}/$stg/$ecr_repository:$IMAGE_TAG +1 additional tag.' failed with exit code 125.
stdout:

stderr:
invalid argument "{build_args.REGISTRY}/$stg/$ecr_repository:$IMAGE_TAG" for "-t, --tag" flag: invalid reference format
See 'docker build --help'.



Use `--keep-sandboxes=on_failure` to preserve the process chroot for inspection.

github action ci file

run: |
          ./pants publish \
          --docker-build-args='[ \
            "DD_SERVICE=payhere-hero-cx", \
            "DD_ENV=stg", \
            "DD_VERSION=$IMAGE_TAG", \
            "IMAGE_TAG=$IMAGE_TAG", \
            "REGISTRY=$ECR_REGISTRY", \
            "REPOSITORY=$STG/$ECR_REPOSITORY", \
          ]' payhere/app_services/hero_cx:payhere_hero_cx

I got the error with invalid argument. I am using docker plugin. Is anybody able to help?

Hey, Why does the

run

goal fail when the applied filters return nothing? I am trying to run DB migrations if there is any change detected in my microservice migrations, but if I use the

--changed-since

flag and nothing is detected, it fails my ci. I also tried the

list

goal and piped the result into a run, same thing. Any ideas?

Can I pass environment variables to

./pants export ::

? When I run the command it fails on compiling grpcio (MacOS). I have solved it by setting a few env variables in my zsh profile, but they don't seem to be present when

./pants export ::

runs.

GoLang go.mod question I've been able to configure an example project with go.mod file and a

go_mod

target in a BUILD file at the monorepo root.

go_binary

in sub directories pick this up. I would like to mirror the convention used for Python and place the go.mod and associated build file in [monorepo root]/3rdParty/go/ Is this possible? When I try. pants reports `The target ... does not have a

go_mod

target in its BUILD file or any ancestor BUILD files.`

dependencies

on `go_package`does not resolve the go mod target

Hi am setting up pants for the first time on a new branch and setting up CI for it but I am getting the following output from git

Are you sure you have a

develop

branch on the git remote? Does it work with

./pants --changed-since=develop tailor

Does it work with

./pants --changed-since=main test tailor

(or whatever you name your main brach)?

If it's a shallow clone or similar, that could cause it

I have found the act tool helpful when getting Github actions working

I have a script which uses the gitpython utility, is there anyway to include my git history / context in the pex_binary target?

Hi, I have a project structure as below:

Tree of: /root/project

.

|__apps

| |__app1

| |__app2

| |__app3

And I have the

root_patterns

declared as:

[source]

root_patterns = [

"/apps/app2",

"/apps/app3",

]

But the command

./pants tailor ::

is generating

BUILD

files in

apps/app1

too. I don’t want that to happen. Could anyone please help?

Is there a way I can write a custom "bootstrap" script for

pants

? I use CodeArtifact for a private PyPi repository, so I need

CODEARTIFACT_AUTH_TOKEN

to be set in the environment. It'd be pretty cool if I could somehow hook into the bootstrap process to: • check if the

CODEARTIFACT_AUTH_TOKEN

environment variable is set. ◦ if so, continue ◦ if not, set it ▪︎ upon failure, throw an error message telling the dev what to do Is this possible? Thanks!

Is there a common way to identify

--changed-since

on

main

branches after a PR is merged? For example, with this workflow: 1. A PR is opened, we can use

--changed-since=origin/main

to detect everything that's new on the PR. 2. The PR is merged to

main

. We want to run a command with effectively the same files that "changed-since" on the PR, but we can't use

origin/main

anymore. A few thoughts in the 🧵

What would be the best way to achieve the

publish

Goal for

docker_image

to put a dynamic Tag, I have already have a Git Tag with

semver

accessible at this moment in my ci/cd, so if I have

1.2.3

, how could I publish to my repository using the same tag

1.2.3

?