pantsbuild #general

Channels

welcome

github-notifications

announce

modern-wolf-36228

11/26/2021, 10:53 AM

how can I just publish only python_distribution target types?

modern-wolf-36228

11/26/2021, 10:57 AM

I guess

./pants filter --target-type=python_distribution :: | xargs ./pants publish

👍 3

modern-wolf-36228

11/26/2021, 12:54 PM

If I want to build a docker image with a wheel (considering that I use a custom version plugin), how would I copy that wheel?

modern-wolf-36228

11/26/2021, 1:20 PM

modern-wolf-36228

11/26/2021, 2:24 PM

Is there an example of custom docker tag plugin?

refined-addition-53644

11/26/2021, 4:25 PM

Hi, I have a question regarding pants and poetry integration. We are building a monorepo where multiple python projects generated using poetry are included. From the documentation I understand that pants uses the

pyproject.toml

generated by poetry using BUILD. I am not able to generate a python distribution for

internal-project1

because I think there is no

main.py

file and hence it doesn't show in the target list

Copy code

repo
|
+-- src/
|   |
|   +-- internal-project1/
|   |   |
|   |   +-- pyproject.toml
|   |   +-- BUILD
|   |   +-- internal_project1/
|   |   |
|   +-- internal-project2/
|   |   |
|   |   +-- pyproject.toml
|   |   +-- BUILD
|   |   +-- internal_project2/
|   |   |
+-- pants
|
+-- pants.toml
|
+-- BUILD
|
+-- requirements.txt

curved-television-6568

11/27/2021, 5:44 PM

Dear

docker

backend users, I’d like to hear your thoughts on this issue: https://github.com/pantsbuild/pants/issues/13718 Thanks ❤️

shy-advantage-49800

11/28/2021, 12:44 PM

Copy code

class CustomSetupKwargsRequest(SetupKwargsRequest):
    @classmethod
    def is_applicable(cls, _: Target) -> bool:
        return True


@rule(level=LogLevel.DEBUG)
async def setup_kwargs_plugin(request: CustomSetupKwargsRequest) -> SetupKwargs:
    result = await Get(
        ProcessResult,
        Process(
            argv=["/bin/git", "rev-parse", "--short", "HEAD"],
            description="Retrieve last commit hash.",
        ),
    )

I'm not sure if I'm doing it the way it should be, but is this the right way to get the commit hash? I need to add a

input_digest

and

working_directory

as well, I guess? Am I supposed to create a Snapshot with

.git

? 🤔

modern-wolf-36228

11/29/2021, 4:22 PM

I'm able to

docker login

, but I'm not able to

./pants package ::

(with

docker_image

Copy code

failed to dial gRPC: cannot connect to the Docker daemon. Is 'docker daemon' running on this host?: dial unix /var/run/docker.sock: connect: no such file or directory

Ideas? 😗

curved-television-6568

11/29/2021, 4:27 PM

Are you using

DOCKER_HOST

option, to use another connection option than default?

ambitious-petabyte-59095

11/29/2021, 4:55 PM

Hi there, I'm trying to build a node docker image through Pants but I'm having trouble understanding the right way to do it. Can someone help guide me?

Copy code

// services/frontend/BUILD 

docker_image(name="front", dependencies=[":public", ":package", ":config"])

resources(
    name="package",
    sources=["services/frontend/package*.json"],
)
resource(
    name="config",
    source="services/frontend/vue.config.js"
)

resources(
    name="public",
    sources=["services/frontend/public/*"],
)

Copy code

// services/frontend/Dockerfile 
FROM node:17.1.0 as build-stage

WORKDIR /app
COPY package*.json ./
RUN npm install

COPY public .
COPY package.json ./
COPY vue.config.js ./

RUN npm run build

Copy code

// General Project Structure 

services
    - frontend / 
        - public/
              - data/ 
              - fonts/
        - BUILD 
        - Dockerfile
        - package.json
        - vue.config.js 
src 
   - js / 
   - python / 
BUILD
pants.toml 
requirements.txt

I keep encountering:

Copy code

#12 [7/8] COPY vue.config.js ./
#12 ERROR: "/vue.config.js" not found: not found

#10 [5/8] COPY public .
#10 ERROR: "/public" not found: not found

#11 [6/8] COPY package.json ./
#11 ERROR: "/package.json" not found: not found

Thanks so much

quiet-evening-25363

11/30/2021, 2:33 AM

Hi all, hopefully this is a dumb question! I'm having trouble with a simple example of importing a JSON file defined in a

resource

rule into a test. I'll post the code and test output in the thread, but

pkgutil.get_data("util", "test.json")

always returns

None

. A related question... • Is there a better way to debug whether the file is included in the package other than inferring from the output of

pants peek

? Thanks!

dazzling-diamond-4749

11/30/2021, 7:00 AM

I'm getting intermittent error when running 2.8

Copy code

22:57:33.50 [ERROR] 1 Exception encountered:

  Exception: Client error (404) downloading file grpc_python_plugin from <https://binaries.pantsbuild.org/bin/grpc_python_plugin/1.32.0/macos/grpc_python_plugin>

I thought this bug was fixed.

modern-wolf-36228

11/30/2021, 8:48 AM

And if the answer is yes? (because maybe is being used, but by the tool I'm using, not directly by me)

modern-wolf-36228

11/30/2021, 8:49 AM

env_vars = ["DOCKER_CONTEXT=pants_context", "DOCKER_HOST"]

I've added this 🤔

modern-wolf-36228

11/30/2021, 9:16 AM

Ah... I solved the issue with it, but BitBucket doesn't support BuildKit ;/

curved-television-6568

11/30/2021, 9:20 AM

Great. I think there’s definitely room for improvement here, to aid get the setup working. Like, should we inherit all

DOCKER_*

env vars by default? Or just report that they exist with configuration that we don’t use, unless explicitly added?

modern-wolf-36228

11/30/2021, 9:23 AM

maybe giving hints in case of some errors? e.g. "Have you added DOCKER_HOST?"

👍 1

modern-wolf-36228

11/30/2021, 9:23 AM

to the [docker]

refined-addition-53644

11/30/2021, 9:42 AM

Is there some plan to add pants command to read/update the

version

of a python package? Like for semantic versioning

Copy code

./pants version minor <python_package>

clean-night-52582

11/30/2021, 11:50 AM

How does pants do building pex files from remote execution? I'm getting OOM in my CI server b/c it seems like it might hold too much in memory. I was thinking about switching it over to do more swap. I wonder if pants is memory aware as it will dump to disk when needed or if my CI/CD pipeline needs work.

modern-wolf-36228

11/30/2021, 12:50 PM

Are there plans to create CLI shortcuts like

--no-process-execution-local-cleanup

-n

? 😗

happy-kitchen-89482

11/30/2021, 1:30 PM

I thought it was too. But weird that it's intermittent! That bug would have been consistent. Which exact Pants version are you on?

narrow-vegetable-37489

11/30/2021, 2:12 PM

Hmm. Having some issues with

./pants publish

and

DOCKER_HOST

in our CI environment.

./pants package

is connecting to the custom daemon address specified in

DOCKER_HOST

just fine, but when running

./pants publish

I get "Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?".

stale-nightfall-29801

11/30/2021, 4:22 PM

I'm slowly but surely converting our codebase to use Pants... And I've just hit the following issue: my

pex_binary

depends on a

python_library

and when it's packed up the pex contains

mylib/[python_file_i_need.py | __init__.py]

Which seems fine, I've seen it do this in other places in my codebase and work... BUT in the

__init__.py

other parts of

mylib

are imported so I'm getting:

ModuleNotFoundError: No module named ...

errors. Do I need to explicitly depend on the rest of the library (or at least the part pulled into init_.py ?

dazzling-diamond-4749

11/30/2021, 4:47 PM

2.8.0

dazzling-diamond-4749

11/30/2021, 4:47 PM

no rc modifier

dazzling-diamond-4749

11/30/2021, 4:48 PM

Looks like the bug is consistent. Never mind the intermittent part

creamy-airplane-38079

11/30/2021, 5:14 PM

Question regarding pants and yarn. In pants 1.30.X, is it possible to specify in toml file, the path to a yarnrc file ? Looked up the documentation specifically under node.js but couldn't find a good reference( I might be looking in the wrong place though). Trying to tell pants to use a specific yarn version from a executable that is stored in the repo ( i.e yarn-1.22.15.cjs)

happy-kitchen-89482

11/30/2021, 5:44 PM

Ah, OK