pantsbuild #general

Channels

welcome

github-notifications

announce

jolly-midnight-72759

10/05/2020, 10:49 PM

I'm getting a

ModuleNotFoundError: No module named 'pants.backend.python.targets'

on my branch for testing 2.0.0b3. Has this moved to

'pants.backend.python.targets_types'

hundreds-father-404

10/06/2020, 2:34 AM

fyi we added a new #plugins channel for help with writing plugins. Thanks @jolly-midnight-72759 for the suggestion!

🔥 1

crooked-gpu-88495

10/06/2020, 4:10 PM

Copy code

(py-3.7.4) ip-192-168-1-5:cr_python gisela.rossi$ ./pants test insights::
16:02:53 [INFO] Resolving new plugins...:
  boto3==1.12.39
  pantsbuild.pants.contrib.mypy==1.30.0
16:02:53 [ERROR] pid: 20059 -> /Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/pants.MObBZj/install/bin/python3.7 /Users/gisela.rossi/.pex/pip.pex/6bd62cbe8c9f1ae82b35f976967538908799cbd6 --disable-pip-version-check --isolated --no-python-version-warning -q --cache-dir /Users/gisela.rossi/.cache/pants/plugins download --dest /var/folders/bs/6rtnc7gx44g40tkjb5vc16xw0000gp/T/tmp7wp31t2k/cp37-cp37m --index-url <https://pypi.org/simple/> --header Cache-Control:max-age=3600 --retries 5 --timeout 15 boto3==1.12.39 pantsbuild.pants.contrib.mypy==1.30.0 raised Executing /Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/pants.MObBZj/install/bin/python3.7 /Users/gisela.rossi/.pex/pip.pex/6bd62cbe8c9f1ae82b35f976967538908799cbd6 --disable-pip-version-check --isolated --no-python-version-warning -q --cache-dir /Users/gisela.rossi/.cache/pants/plugins download --dest /var/folders/bs/6rtnc7gx44g40tkjb5vc16xw0000gp/T/tmp7wp31t2k/cp37-cp37m --index-url <https://pypi.org/simple/> --header Cache-Control:max-age=3600 --retries 5 --timeout 15 boto3==1.12.39 pantsbuild.pants.contrib.mypy==1.30.0 failed with -9
Traceback (most recent call last):
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/bin/daemon_pants_runner.py", line 144, in _run
    os.environ, options_bootstrapper, scheduler=scheduler
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/bin/local_pants_runner.py", line 137, in create
    options, build_config = LocalPantsRunner.parse_options(options_bootstrapper)
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/bin/local_pants_runner.py", line 72, in parse_options
    build_config = BuildConfigInitializer.get(options_bootstrapper)
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/init/options_initializer.py", line 40, in get
    cls._cached_build_config = cls(options_bootstrapper).setup()
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/init/options_initializer.py", line 50, in __init__
    self._working_set = PluginResolver(self._options_bootstrapper).resolve()
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/init/plugin_resolver.py", line 64, in resolve
    for resolved_plugin_location in self._resolve_plugin_locations():
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/init/plugin_resolver.py", line 89, in _resolve_plugin_locations
    for plugin in self._resolve_plugins():
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pants/init/plugin_resolver.py", line 107, in _resolve_plugins
    allow_prereleases=PANTS_SEMVER.is_prerelease,
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pex/resolver.py", line 741, in resolve
    ignore_errors=ignore_errors)
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pex/resolver.py", line 860, in resolve_multi
    max_parallel_jobs=max_parallel_jobs
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pex/resolver.py", line 948, in _download_internal
    max_parallel_jobs=max_parallel_jobs
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pex/resolver.py", line 202, in download_distributions
    max_jobs=max_parallel_jobs
  File "/Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/1.30.0_py37/lib/python3.7/site-packages/pex/jobs.py", line 219, in execute_parallel
    raise error
pex.resolver.Unsatisfiable: pid: 20059 -> /Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/pants.MObBZj/install/bin/python3.7 /Users/gisela.rossi/.pex/pip.pex/6bd62cbe8c9f1ae82b35f976967538908799cbd6 --disable-pip-version-check --isolated --no-python-version-warning -q --cache-dir /Users/gisela.rossi/.cache/pants/plugins download --dest /var/folders/bs/6rtnc7gx44g40tkjb5vc16xw0000gp/T/tmp7wp31t2k/cp37-cp37m --index-url <https://pypi.org/simple/> --header Cache-Control:max-age=3600 --retries 5 --timeout 15 boto3==1.12.39 pantsbuild.pants.contrib.mypy==1.30.0 raised Executing /Users/gisela.rossi/.cache/pants/setup/bootstrap-Darwin-x86_64/pants.MObBZj/install/bin/python3.7 /Users/gisela.rossi/.pex/pip.pex/6bd62cbe8c9f1ae82b35f976967538908799cbd6 --disable-pip-version-check --isolated --no-python-version-warning -q --cache-dir /Users/gisela.rossi/.cache/pants/plugins download --dest /var/folders/bs/6rtnc7gx44g40tkjb5vc16xw0000gp/T/tmp7wp31t2k/cp37-cp37m --index-url <https://pypi.org/simple/> --header Cache-Control:max-age=3600 --retries 5 --timeout 15 boto3==1.12.39 pantsbuild.pants.contrib.mypy==1.30.0 failed with -9

crooked-gpu-88495

10/06/2020, 4:10 PM

hey - this might be silly problem but I've been trying to fix it for 3 weeks and I feel a bit defeated. I had to do a complete wipe of my mac and install everything again. Since then my pants set up is not working. I'm so lost I'm not sure I understand what's the actual issue as I've been surfing from one error to the next. The one I'm getting now is:

crooked-gpu-88495

10/06/2020, 4:10 PM

any help welcomed 🙏

calm-ambulance-65371

10/06/2020, 10:04 PM

Hello, I'm currently trying to write a Cython plugin for Pants 2.0.0b3 and it's unclear to me what the output type for the rule should be

astonishing-fish-21892

10/07/2020, 6:01 AM

Hello! I'm trying to write a custom target in order to compile Open Dynamics Engine (written in C) & import the Python library that gets generated as an artifact of compilation into my project. Is there already a way that Pants 2 can do something like this? or am I going to have to write a plugin myself? For reference, here's the compilation process that I'm currently performing manually:

Copy code

(env)$ cd ode-0.16.2
(env)$ ./configure --enable-double-precision --with-trimesh=opcode --enable-new-trimesh --enable-shared
(env)$ make
(env)$ make install
(env)$ cd bindings/python/
(env)$ pip install cython
(env)$ pip install .

rapid-flag-11972

10/08/2020, 4:09 PM

Hello, I’m writing a CI pipeline with gitlab and pants and I’m not able to get linting or formatting to work. I have ensured I have pants installed and working as

./pants --version

gives me the version I’m running (

1.30.0rc0

). When I run

./pants --print-exception-stacktrace fmt ::

pants tells me if changes were made by black, docformatter and isort as it should. So I know that pants is able to format/lint code. However after this I get the following output:

Copy code

14:36:33 00:00 [main]
               (To run a reporting server: ./pants server)
14:37:04 00:31   [setup]
14:37:04 00:31     [parse]
               Executing tasks in goals: bootstrap -> fmt
14:37:04 00:31   [bootstrap]
14:37:04 00:31     [substitute-aliased-targets]
14:37:04 00:31     [jar-dependency-management]
14:37:04 00:31   [complete]
               FAILURE
FAILURE: Problem locating a java distribution: Failed to locate a JDK distribution with minimum_version None, maximum_version None
Cleaning up file based variables
00:01
ERROR: Job failed: exit code 1

I have ensured that my custom docker image has java and is working as I am able to do

java -version

during the same job. Here is the output when checking if java was installed:

Copy code

$ java -version
openjdk version "11.0.8" 2020-07-14
OpenJDK Runtime Environment (build 11.0.8+10-post-Debian-1deb10u1)
OpenJDK 64-Bit Server VM (build 11.0.8+10-post-Debian-1deb10u1, mixed mode, sharing)

The project itself is python based but since pants told me it wasn’t able to find a java installation I made a custom image with openjdk-11 installed. Any help is appreciated, thanks!

chilly-magazine-21545

10/11/2020, 6:14 PM

i had to make a new account since my old one (@aloof-angle-91616) was tied to my twitter email, in case anyone was wondering

👋 1

❗ 1

fast-nail-55400

10/11/2020, 6:51 PM

maybe someone with admin can change the email of the old account to the new email? as per https://slack.com/help/articles/225531168-Change-a-members-email-address

calm-ambulance-65371

10/12/2020, 2:18 PM

Is pants still largely a Twitter project?

calm-ambulance-65371

10/12/2020, 3:27 PM

Is remote execution considered stable? It looks like the CLI flags mark it as alpha

fresh-architect-74417

10/12/2020, 3:47 PM

Have anyone used mutation tests before?

calm-ambulance-65371

10/12/2020, 3:48 PM

We've talked about it but have not implemented it

hundreds-father-404

10/12/2020, 4:01 PM

I’d say it mostly depends on what provider you use. Pants implements the open source Remote Execution API, so there are several different servers you can hook up to, or implement your own (non-trivial). Pants is the client. For Pants’s own CI, we were using Google’s RBE service for three months and it was awesome having 20 worker, compared to Travis’s 2 core CPU. But Google shut that down last month :/ There are some things that will need polish for Pants’s client-side, though, to be really ergonomic, e.g.: * better support for having different config for remote vs. local (Bazel’s “toolchains”) * speculation, meaning you can try local and remote, and go with what’s fastest For Toolchain’s remote execution/caching services we plan to offer, we’re focusing first on remote caching, and then will followup with remote execution.

hundreds-father-404

10/12/2020, 4:04 PM

Let us know if we can improve Pants to help facilitate mutation testing, e.g. helping to write a plugin to integrate with Mutmut

👍 2

fast-nail-55400

10/12/2020, 4:36 PM

I would add that Pants does not really support running the client on a different execution environment than the remote execution environment. For example, macOS client and Linux remote execution environment is an open issue.

👍 2

fast-nail-55400

10/12/2020, 4:36 PM

remote caching is the more tractable problem, and will likely be in 2.1.x

fast-nail-55400

10/12/2020, 4:37 PM

(I have it working locally on my laptop, PR to come this week)

fast-nail-55400

10/12/2020, 4:40 PM

as for remote execution, please feel free to ask any specifics in #remoting. We finally got Pants added to the remote-apis-testing framework so despite the caveats, Pants is compatible with Buildfarm, BuildBarn, and BuildGrid.

calm-ambulance-65371

10/12/2020, 4:48 PM

we're basically just looking to have the jobs execute on one of our physical servers

calm-ambulance-65371

10/12/2020, 4:49 PM

it should be entirely homogeneous

fast-nail-55400

10/12/2020, 4:49 PM

it should work for that use case. that is basically the narrow use case for which it does actually work currently.

calm-ambulance-65371

10/12/2020, 4:50 PM

nice, can you point me towards the software/docs to set that up?

fast-nail-55400

10/12/2020, 4:51 PM

I’ll have to write the Pants client docs for that. For server-side docs, depends on which server (Buildfarm, Buildbarn, Buildgrid) you want to choose.

fast-nail-55400

10/12/2020, 4:52 PM

buildbarn, for example, has example deployments at https://github.com/buildbarn/bb-deployments

fast-nail-55400

10/12/2020, 4:52 PM

buildgrid has example deployments at https://gitlab.com/BuildGrid/buildgrid-deployments

calm-ambulance-65371

10/12/2020, 4:52 PM

cool, that's exactly what I was looking for. Thanks!

fast-nail-55400

10/12/2020, 4:53 PM

I suggest joining buildteamworld.slack.com

fast-nail-55400

10/12/2020, 4:53 PM

there’s a channel for each of the major server projects

👍 1