pantsbuild #general

Channels

welcome

github-notifications

announce

limited-insurance-37393

04/28/2021, 7:42 PM

So, I've got a

templates

directory in my repository that has some Python files and other templates, but shouldn't necessarily have any BUILD files. When I run

./pants tailor

it errors out because one of the subdirectories doesn't have a BUILD file, and there doesn't appear to be a way to tell the command to ignore any directories, or to tell it to run only against the

src/

directory.

echoing-manchester-70122

04/28/2021, 8:31 PM

What’s the best way to use a pex with multiple entry points?

echoing-manchester-70122

04/28/2021, 8:31 PM

We’ve been creating a script like this for each entrypoint but I’m interested in doing it within the BUILD file if possible

echoing-manchester-70122

04/28/2021, 8:32 PM

Copy code

#!/bin/sh
PEX_MODULE=foo:main /usr/local/bin/foo_and_bar.pex "$@"

plain-carpet-73994

04/28/2021, 9:49 PM

It's not possible to generate any files outside of the sandbox, is it? I was hoping to have a task that creates and populates a

venv

but I think that can't be done from within Pants, right?

user

04/29/2021, 2:20 AM

https://twitter.com/gerbenjacobs/status/1384106906046795779 Pants Build retweeted: I just pushed a non-functional commit to make my build pipeline work again.. somehow NASA patched software for thei… https://twitter.com/i/web/status/1384106906046795779 Twitter

helpful-lunch-92084

04/29/2021, 3:14 PM

hey, we just upgraded from 2.2.0 to 2.2.2 and started getting this type of error on some of our build jobs:

Copy code

MDB_MAP_FULL: Environment mapsize limit reached"

Any suggestions?

user

04/29/2021, 5:11 PM

https://twitter.com/pantsbuild/status/1387816849564487687 Pants Build maintainer @benjy discusses when and how to use a monorepo for Python https://cfp.pycon.org.il/conference2021/talk/VKPEP3/ on Monday (May 3, 1600–1625 UTC+3) There are 2 data science tracks to eagerly look forward to, in addition to the 2 general tracks. Register now; conf starts this Sunday. Twitter We're almost at 1000 attendees for PyCon Israel 2021 !! 🎟️🐍 To get your tickets for free and join us for some… https://twitter.com/i/web/status/1387693332793593858 Twitter

🔖 1

user

04/29/2021, 6:45 PM

https://twitter.com/pantsbuild/status/1387840483645349890 Pex 2.1.41 is released: + https://pypi.org/project/pex/2.1.41/ + https://github.com/pantsbuild/pex/releases/tag/v2.1.41 Twitter

cuddly-flag-68085

04/29/2021, 8:39 PM

Trying to debug pants cache in docker. Was wondering if I can get some help? 🙏 We are trying to build our pants jar inside of a docker instance running on ubuntu. In order to speed up the build, I was hoping to persist the pants cache for future builds. It seems like the right way to do that is this:

ENV XDG_CACHE_HOME /root/.cache

(src)

RUN --mount=type=cache,target=/root/.cache/ ./pants binary some/jar/to/build:

But all subsequent docker runs dont use any cached data, and the build starts from scratch. Are there any examples of pants + docker + caching that are known to work?

busy-vase-39202

04/29/2021, 9:54 PM

Toolchain has a booth on Startup Row at Pycon, where @happy-kitchen-89482 @hundreds-father-404 and others will be showing demos of Pants in action. It would be great to have your POV on what to show. So, some questions:

plain-carpet-73994

04/29/2021, 11:02 PM

I want to add a goal called

check

that runs

lint

typecheck

, etc. I know with a macro you can create multiple targets but it doesn't look like macros let you combine goals. I can create a custom rule but (1) is that necessary and (2) if so, I think I need to do some

await Get(LintResult, Target, target)

like calls, once for each target, but I'm not sure what the right types to

await

are for the other goals -- how do I find those?

user

04/30/2021, 3:54 PM

https://twitter.com/pantsbuild/status/1388159813041807367 Introducing Pants Build 2.4.0: https://blog.pantsbuild.org/introducing-pants-build-2-4-0/ Twitter

🚀 3

polite-garden-50641

04/30/2021, 5:06 PM

where is the constraint to use python 3.8.6 can come from ? it is not in pants.toml (in any of the interpreter constraints settings) where else could it be defined?

proud-jackal-16497

04/30/2021, 6:40 PM

hey, have a quick question about using

--changed-since

flag in v1.30 when using a custom target

plain-carpet-73994

05/01/2021, 12:37 AM

Hey - have an odd issue with some tests. I have a package called

utils

with an

__init__.py

that looks like this:

Copy code

from .require import require
from .foo import foo

__all__ = ['require', 'foo']

and the

foo.py

and

require.py

files exist and can be imported from other packages as expected (e.g.

import utils.require

). I added a unit test for

foo

which does not use

require

require

currently doesn't have any unit tests. My BUILD file is super simple:

Copy code

python_library()

python_tests(name='test')

When I try to run the tests in

utils

I get:

Copy code

E   ModuleNotFoundError: No module named 'utils.require'

My theory is that since I'm not using

require

in any tests that file doesn't get put in my sandbox so it's not available and I therefore get the error. But adding a

dependencies=['./:utils']

to my

python_tests

target doesn't help either. Having an

__init__.py

that exports a bunch of things some of which may not have unit tests seems fairly common so I suspect I'm doing something wrong. Any advice?

plain-carpet-73994

05/01/2021, 12:59 AM

One more question. I've got a CI going and I'm caching the

~/.cache/python/setup

directory but on each build I see the

./pants

script re-downloading pants and re-installing the associated pip packages. Am I doing something wrong?

user

05/01/2021, 3:54 PM

https://twitter.com/pyconil/status/1388501070679269382 Pants Build retweeted: PyCon Israel 2021 is Tomorrow !! 🎉 Join us for some #pythonfun 🎟️ 🐍 https://canapii.com/events/pycon-israel-2021/register/ticket-d32387de-b258-4996-a7c5-93fdef8b9cd9 #python #PyCon Twitter

🙌 2

salmon-nest-5801

05/01/2021, 10:22 PM

Hello everyone 👋. I'm running into a strange issue that I can't seem to sort out and I'm wondering if anyone else has any suggestions. My company uses dynamic SSL Inspection so we have an SSL Certificate we need to inject into our CA bundle. I've done that on my system. I've generated a pem bundle (I've even written a nice tool that does this from the macOS keychain, and puts it in a place the homebrew openssl expects it to be). I've set the requisite

REQUESTS_CA_BUNDLE

and

PIP_CERT

, etc. I've also experimented with

PANTS_CA_CERTS_PATH

and

--ca-certs-path=${SSL_CERT_FILE}

(the variable being a handy reference to the bundle I generated). But regardless of what I set, I always get the following when trying to do anything other than

--version

with pants:

Copy code

Exception: Error downloading file: error sending request for url (<https://github.com/pantsbuild/pex/releases/download/v2.1.35/pex>): error trying to connect: invalid certificate: BadDER

I thought maybe there was some sort of issue with pants not liking the openssl that homebrew has installed, and that maybe I needed to rebuild it from sources, so I attempted that - same output. I have longer logs from that if anyone wants to see (I didn't post them here as this is already too long). Regardless of what I set, if I set those variables, if I don't set them, I get the same response. I know

pip

and anything

requests

based work perfectly fine on my system - I needed those awhile ago and I sorted them out; I know for sure that the generated bundle works perfectly fine with those tools, and other things like

pip

pipenv

poetry

, etc. Any ideas? I'm just looking for a workaround that isn't getting out from behind the SSL Inspection server (I could, but then this won't work for anyone if they're ever inside the company intranet, and that's not really a solution). I can set whatever complicated environment I need. I know I could host the artifacts myself a-la proxy limitations, but I'd really rather not do that either. I really think this should work, I just can't figure out why it doesn't.

happy-kitchen-89482

05/02/2021, 10:42 PM

Draft of a help page for setting up IDEs with Pants: https://www.pantsbuild.org/v2.5/docs/setting-up-an-ide

👀 1

happy-kitchen-89482

05/02/2021, 10:42 PM

Comments welcome

plain-carpet-73994

05/03/2021, 6:03 PM

I've got a constraints file generated by

pip-compile

that includes an extra like:

Copy code

google-api-core[grpc]==1.26.3

but Pants doesn't like that:

Copy code

DEPRECATION: Constraints are only allowed to take the form of a package name and a version specifier. Other forms were originally permitted as an accident of the implementation, but were undocumented. The new implementation of the resolver no longer supports these forms. A possible replacement is replacing the constraint with a requirement.. You can find discussion regarding this at <https://github.com/pypa/pip/issues/8210>.
ERROR: Constraints cannot have extras

Aren't extras required for proper support in some cases? What's the correct way to deal with an optional extra that is required by the code if I want to be freezing dependencies?

big-xylophone-43403

05/03/2021, 6:20 PM

Hi, I’ve a dependency inference question when running tests - 🧵

user

05/03/2021, 7:21 PM

https://twitter.com/pantsbuild/status/1389299051682844675 Comments much appreciated for this draft page on setting up IDEs with Pants: https://www.pantsbuild.org/v2.5/docs/setting-up-an-ide Twitter

🙏 1

user

05/03/2021, 8:07 PM

https://twitter.com/pantsbuild/status/1389310745339432964 Slides from Pants maintainer @benjy’s talk today at @pyconil, “Python Monorepos: What, Why, and How”. https://t.co/EaXy89jyJK The conference plans to upload video soon. Twitter

square-oxygen-75288

05/04/2021, 11:10 AM

Hello! My system python version was updated to 3.9.x (because of Ubuntu 20.04 -> 21.04 upgrade) Now my IDEA complains about python version when I try to refresh the project:

Copy code

No valid Python interpreter found. For `pants_version = "1.30.0"`, Pants requires Python 3.6, 3.7, or 3.8 to run. Please check that a valid interpreter is installed and on your $PATH.

If I open IDEA's terminal and run

python

there, I will see:

Copy code

% python
Python 3.8.6 (default, May  4 2021, 09:31:45) 
[GCC 10.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>

Cause I have pyenv configured for this (scala) project So I don't get how to get Pants in IDEA up and running cause it seems like it tries to use 3.9.x and fails (and it ignored pyenv) Any ideas how to fix it? Cheers.

polite-garden-50641

05/04/2021, 2:27 PM

I suggest adding to the pants config in CI docs (https://www.pantsbuild.org/docs/using-pants-in-ci) instructions on how to tell the CI system to retain the pants log file (

.pants.d/pants.log

) we do it in pants: https://github.com/pantsbuild/pants/pull/11860 and this is also possible in other CI systems, for example circle ci: https://circleci.com/docs/2.0/artifacts/ BTW - travis can't do it on its own (it only allows uploading somewhere else, like s3) so we might want to reconsider using it as an example in the docs and in the example-python repo... since I don't think anyone using pants 2.x will be using travis.... (I would be surprised....) so a GH actions/CircleCI makes more sense. since those are the more common ones people are familiar with (and are not slowly dying).

➕ 1

user

05/04/2021, 5:54 PM

https://twitter.com/pyblogsal/status/1385587441323716611 Pants Build retweeted: My "magnum opus" for better SyntaxErrors is finished in time to be included in Python 3.10. Now when the interprete… https://twitter.com/i/web/status/1385587441323716611 Twitter

plain-sundown-25537

05/04/2021, 7:13 PM

Do we have a barebone python project template? I know we have an example repo. But my goal is to tell our DS/MLE - copy this folder

foobar

myproject

and start with it

➕ 1

proud-dentist-22844

05/04/2021, 7:49 PM

It might be interesting to have a template based on https://copier.readthedocs.io/en/stable/ - or even adjust

tailor

to use copier for a smarter / updatable repo template.