pantsbuild #general

Channels

welcome

github-notifications

announce

jolly-midnight-72759

08/25/2020, 12:21 AM

Are the following variables still available in the

pants.toml

and other config files for versions 1.27 to 1.30 (V1 engine for now)?

Copy code

# All of the following are seeded with defaults in the config
#   user: the current user
#   homedir: the current user's home directory
#   buildroot: the root of this repo
#   pants_bootstrapdir: the global pants scratch space primarily used for caches
#   pants_configdir: the global pants storage for config files
#   pants_distdir: user visible artifacts for this repo go here
#   pants_workdir: the scratch space used to for live builds in this repo

full-oyster-41619

08/25/2020, 7:11 AM

latest stable 1.30. do you have a doc on how to write goals?

polite-vase-75369

08/25/2020, 1:37 PM

Are there any examples / example repos on how to use pants for golang code?

happy-kitchen-89482

08/25/2020, 9:18 PM

Hi all, happy to announce that the first alpha release in the 2.x series, 2.0.0a0, is out! https://pypi.org/project/pantsbuild.pants/2.0.0a0/ There is one major caveat, which is that we have temporarily disabled protobuf support, while we work through a performance issue it causes in rule graph construction. If you're using protobuf, then please hold off on this release, but otherwise we'd really appreciate it if you could try it out in a branch and report back on any issues, here or via github (https://github.com/pantsbuild/pants/issues/new). Rest assured that we will be restoring protobuf support ASAP, and certainly before we create 2.0.0 release candidates. This release puts us on the home stretch towards the epic 2.0 milestone. My deepest thanks to everyone who contributed code, bug reports and feedback so far!

👖 4

💯 3

🔥 3

jolly-midnight-72759

08/25/2020, 10:52 PM

We have a script that parses the set values

./pants help-advanced

outputs. This is done differently in v1.18, v1.30, and v2.0.0. Is there a way to get a "machine friendly" output using

./pants

? I am thinking something like

./pants meta --section="GENERAL" --key="pants_workdir"

plain-river-51682

08/26/2020, 12:18 PM

Hey, after updating from pants 1.25 to 1.29 we see this error sometimes in our CI runs:

Copy code

Build graph construction failed: ExecutionError 1 Exception encountered:
  Exception: Snapshot failed: Throw { val: Error { kind: Io(Os { code: 28, kind: Other, message: "No space left on device" }), paths: [] }, python_traceback: "Traceback (no traceback):\n  <pants native internals>\nException: Error { kind: Io(Os { code: 28, kind: Other, message: \"No space left on device\" }), paths: [] }", engine_traceback: ["Fingerprinting: <SOME SCALA FILE>.scala"] }

pants is invoked in gitlab-ci inside a docker container. The host has enough diskspace available. Where is it trying to write?

user

08/26/2020, 9:01 PM

https://twitter.com/stuhood/status/1298720143430696961 Pants Build retweeted: Have you worked with compilers? If so, I'd love your insight on an interesting problem we've been working on:… https://twitter.com/i/web/status/1298720143430696961 Twitter

🐦 2

👖 1

full-oyster-41619

08/27/2020, 3:56 PM

sometimes I get this error

Copy code

error	27-Aug-2020 07:34:27	13:34:27 [ERROR] Unrecognized command line flag '--target-type' on global scope. Suggestions:
error	27-Aug-2020 07:34:27	--filter-target-type, --target-types-details, --target-types-output-file, --target-types-sep

this was my command

Copy code

./pants --version && ./pants --changed-since=develop --changed-include-dependees=transitive filter --target-type=python_library | xargs ./pants setup-py ./pants --changed-since=develop --changed-include-dependees=transitive filter --target-type=python_library | xargs -i ./pants setup-py {} -- sdist && ./pants --changed-since=develop --changed-include-dependees=transitive filter --target-type=python_binary

happy-kitchen-89482

08/27/2020, 6:24 PM

Hmm, I can't reproduce this with any of those commands.

happy-kitchen-89482

08/27/2020, 6:25 PM

Is there a missing

&&

after the first

xargs ./pants setup-py

though?

happy-kitchen-89482

08/27/2020, 6:31 PM

To explain Eric's comment: The

--filter-target-type

flag means "The

target_type

option on the

filter

scope." This can be shortened to

--target-type

if it comes immediately after the

filter

goal on the command line. So that error means that pants encountered

--target-type

not immediately after

filter

happy-kitchen-89482

08/27/2020, 6:31 PM

This seems to be happening because of the missing `&&`:

happy-kitchen-89482

08/27/2020, 6:31 PM

Copy code

./pants setup-py ./pants --changed-since=develop --changed-include-dependees=transitive filter --target-type=python_library
11:31:03.16 [ERROR] Unrecognized command line flag '--target-type' on global scope. Suggestions:
--filter-target-type, --target-types-details, --target-types-output-file, --target-types-sep

happy-kitchen-89482

08/27/2020, 6:32 PM

Whereas

Copy code

/pants setup-py && ./pants --changed-since=develop --changed-include-dependees=transitive filter --target-type=python_library

should work

miniature-lamp-45970

08/28/2020, 12:30 AM

What is the recommended way to set environment variables that are used within integration tests? Is there an option within python_tests Build Rule to pass environment variables?

full-oyster-41619

08/28/2020, 12:42 PM

yes. you are right. my bad. the error code was misleading 🙂

happy-kitchen-89482

08/29/2020, 5:38 PM

The 2.0.0a1 release is available on PyPI! Thanks to all contributors.

❤️ 2

🙌 2

narrow-activity-17405

08/31/2020, 8:02 AM

Hi there! I'm just converting the existing codebase into a monorepo based on Pants. Before, each Python package lived in its own repository and used git tags to get its version. I just discovered that version only in the BUILD file is not enough - some of the code needs access to the version even when not installed so it would be ideal if I can put a version into a VERSION file so any code (including generated setup.py) can read it from there. How can one get custom code into a generated setup.py? Do I need to write a custom target type for this?

narrow-activity-17405

08/31/2020, 8:58 AM

Example situation. Package A defines some integration tests that need to run the binary from package B. I would expect that it would be sufficient to add a dependency on B_dist (python_distribution providing the binary) into A/tests/BUILD and the B package respectively the binary will be installed in the A/tests environment. But it seems that the required binary is not available there (call to subprocess.Popen fails). Do I need to start that binary using another approach? What would you recommend?

narrow-activity-17405

08/31/2020, 9:36 AM

I can also think of starting the binary by "./pants run src/python/package_B/scripts:required_binary" within the package A's integration test script. But still I would prefer the original approach with dependency on _dist as at the time when script starts, everything is already built.

full-oyster-41619

08/31/2020, 11:22 AM

hey. any ideas how to you get the dependencies for a target? From the code it looks like this information is available at the target level, but retrieving a target depends on the build graph and I do not know how to get this information?

Copy code

from pants.backend.python.targets.python_target import PythonTarget
from pants.build_graph.build_graph import BuildGraph
from pants.build_graph.address import Address,

# How to get dependencies?
address = Address(lib_path, lib_name)     
# target = graph??.get_target(address)
# target = PythonTarget(name=name, address=address, build_graph=build_graph???)
dependencies = target.dependencies()

wonderful-iron-54019

08/31/2020, 6:17 PM

hypothetical: I've been refining a

docker_image

target suppose i wanted to include a pex binary as the entrypoint, how could i build the binary into the docker image, given the fact that both targeets are built in a hermetic environment, and i'd need to refer to the binary in my dockerfile

wooden-thailand-8386

08/31/2020, 6:55 PM

Hello there, I’ve been trying to install

pants

inside an alpine docker image and I keep getting this:

Copy code

ERROR: No matching distribution found for pantsbuild.pants==1.30.0

when I do a

pip install pantsbuild.pants==1.30.0

on my host machine is works fine but not inside alpine.

happy-kitchen-89482

09/01/2020, 4:22 AM

To clarify the role of B_dist - it's just a way of providing metadata that gets passed to

setup.py

. Depending on it doesn't do anything. If you want to depend on a published version of B then you do so like any other "3rdparty" requirement (but you have to have published it first). But I'm guessing that's not what you want? Typically since

A/tests

and

are in the same repo you would have

A/tests

depend on

as an internal dependency. That is,

A/tests

python_tests

should depend on B's

python_library

(not its

python_distribution

). Then the test can invoke B's code directly (rather than spawning a process to run it).

happy-kitchen-89482

09/01/2020, 4:23 AM

If you do still need to spawn a process to run the binary, rather than invoke B's code directly, then I'll need to think about how to achieve that. Your idea of depending on the

_dist

target is interesting, but there

happy-kitchen-89482

09/01/2020, 4:23 AM

isn't enough information there to know how to build the

setup.py

into a dist (for example, should it build a wheel or an sdist?)

happy-kitchen-89482

09/01/2020, 4:28 AM

Could you open an issue at https://github.com/pantsbuild/pants/issues/new ? We can use that to discuss the various ideas and see what we can implement that will be useful.

narrow-activity-17405

09/01/2020, 7:49 AM

There are also unit tests where I'm using imported code... But certain integration tests where inter-process communication happens rely on spawning processes (e.g. mock of database, etc.). You are right - depending on a published version is not what I want here. These integration tests (among others) should be run for each PR/push, during development...

narrow-activity-17405

09/01/2020, 7:58 AM

I will open the issue. Thanks for your feedback!

narrow-activity-17405

09/01/2020, 8:22 AM

https://github.com/pantsbuild/pants/issues/10716