pantsbuild #general

Channels

welcome

github-notifications

announce

rapid-crayon-8232

12/15/2019, 4:50 PM

and with

notebook.py

having:

Copy code

import sys

from notebook.notebookapp import main

if __name__ == "__main__":
    sys.exit(main())

dry-analyst-73584

12/16/2019, 6:46 PM

Is there a V2 equivalent of

target.sources_relative_to_source_root()

early-needle-54791

12/18/2019, 6:55 PM

I’m trying to run this test locally

tests/python/pants_test/projects:java_testprojects_integration

on latest master and it fails with

pants.base.specs.Spec.AddressFamilyResolutionError: Path "contrib/python/src/python/pants/contrib/python/checks/checker" does not contain any BUILD files.

which is not true if I look at the source tree. Is this KTF locally?

cold-journalist-66984

12/19/2019, 2:37 PM

Hey, I’m trying to upgrade to pants 1.16 for a project I’m working on (I’m working on a python2->3 migration so it’s the highest version I can use right now). When I try to run

pants compile ::

it fails with `Problem launching via NailgunClient`and

TruncatedHeaderError(u"Failed to read nailgun chunk header...

Do you have any thoughts on how I can go about debugging this? I think I want to see what the nailgun server is up to, but I’m not sure how to get my hands on its output.

➕ 1

happy-kitchen-89482

12/19/2019, 8:08 PM

What do we do about "requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://pants-remoting-beta.appspot.com/token/generate" leading to "Failed to generate a token for remote build execution." on the unittest CI shard? This happens consistently

happy-kitchen-89482

12/19/2019, 8:08 PM

And nuking all the caches doesn't fix it

happy-kitchen-89482

12/19/2019, 8:09 PM

E.g., https://travis-ci.org/pantsbuild/pants/jobs/627293359?utm_medium=notification&utm_source=github_status

happy-kitchen-89482

12/19/2019, 10:27 PM

OK, updating the Travis IPs in our GCP firewall config seems to have fixed the issue

❤️ 2

witty-crayon-22786

12/19/2019, 10:48 PM

huzzah. thank you sir.

damp-quill-59187

12/20/2019, 8:33 PM

Quick question, how do I make a function available in a pants BUILD file. I've noticed the warn against direct imports, and I can't seem to find in the documentation how to do it. i.e.

setup_py

is available as a function call, would like to be able to allow my own function calls. I'm familiar with the plugin setup, but can't seem to be able to wire this piece together

rapid-crayon-8232

12/23/2019, 1:01 PM

hey guys, is there a Goal/Target in pants to only install all dependencies of a particular path? My problem is that I want to use pants in docker, and I don't want to have to rebuild the dependency graph each time I want to generate a binary, so my idea is that I'll install all dependencies in a layer, and then binary goal will rebuild only the parts that changed each time

adamant-mouse-92628

12/25/2019, 7:43 AM

Copy code

FAILURE: Dependencies cannot have a higher java target level than dependees!

  testprojects/src/java/org/pantsbuild/testproject/targetlevels/unspecified:lib targeting "java8"
  is depended on by:
    testprojects/src/java/org/pantsbuild/testproject/targetlevels/unspecified:java7 targeting "java7"

Consider running ./pants jvm-platform-explain with the same targets for more details.


               Waiting for background workers to finish.
23:38:09 00:05   [complete]
               FAILURE
./pants lint :: 7.26s user 2.45s system 141% cpu 6.837 total; max RSS 208216Ki
[37737 23:38:10.490 eax@BuyingEagle ~/svn/pantsbuild/pants !1!]∴pants jvm-platform-explain  ::              (git:pants)-[master]
Scrubbed PYTHONPATH=/Users/eax/svn/pantsbuild/pants/src/python: from the environment.

FAILURE
07:40:51 [WARN] /Users/eax/svn/pantsbuild/pants/src/python/pants/base/exception_sink.py:423: DeprecationWarning: PY_SSIZE_T_CLEAN will be required for '#' formats
  process_title=setproctitle.getproctitle(),


ERROR: transitive

(Use --print-exception-stacktrace to see more error details.)

 6.17s user 2.09s system 182% cpu 4.528 total; max RSS 211964Ki
 6.19s user 2.11s system 181% cpu 4.570 total; max RSS 211964Ki

adamant-mouse-92628

12/25/2019, 7:43 AM

fwiw jvm-platform-explain gave me less info than the original error 😕

hundreds-father-404

12/26/2019, 9:52 PM

Proposal for what

--skip

should look like for V2, including proposing a new

--lint-only='pylint'

option. Comments appreciated 🙂 https://docs.google.com/document/d/13Qwb3JNgm3ogKeSgFz4QAiOs77jnrjfQqM6VqKWRyKM/edit?usp=sharing

hundreds-father-404

12/27/2019, 8:02 PM

MyPy is now running against all of Pants 🎉 https://github.com/pantsbuild/pants/pull/8875 thanks to @aloof-angle-91616 for co-owning this project!

🍾 4

👍 3

aloof-angle-91616

12/27/2019, 8:30 PM

i think mypy is incredible because it’s separate from the language implantation itself, it’s extremely hackable and improving every day, and it’s trying incredibly hard to be practical! thanks so much to @hundreds-father-404 for pushing this super important migration through!!!

🐍 4

happy-kitchen-89482

12/29/2019, 4:28 PM

Fantastic work @hundreds-father-404 et al!

❤️ 1

➕ 2

cold-journalist-66984

01/02/2020, 4:48 PM

I have another project where I’m trying to upgrade the pants version and I’m having some trouble with the config file. I’m upgrading from 1.0.0 to 1.16.0 and I get this error

Copy code

16:45:41 [ERROR] Invalid scope [scala-platform] in /Users/johndowns/src/play-pants/pants.ini
16:45:41 [ERROR] Invalid scope [publish.jar] in /Users/johndowns/src/play-pants/pants.ini
16:45:41 [ERROR] Invalid scope [ivy] in /Users/johndowns/src/play-pants/pants.ini
16:45:41 [ERROR] Invalid scope [jvm-platform] in /Users/johndowns/src/play-pants/pants.ini

I’m fairly certain that

[scala-platfom]

has been renamed to

[scala]

, but when I try to change that header, I get a similar error

16:40:18 [ERROR] Invalid scope [scala] in /Users/johndowns/src/play-pants/pants.ini

This is my

pants.ini

file

Copy code

[GLOBAL]
pants_version: 1.16.0
pythonpath: [
  '%(buildroot)s/build-support'
  ]

backend_packages: [
  'repositories'
  ]

[scala]
version: 2.11

[publish.jar]
repos: {
    'public': {
        'resolver': '<http://oss.sonatype.org|oss.sonatype.org>',
        'auth': ':netrc',
        'help': 'Configure your ~/.netrc',
    }
  }

ivy_settings: %(pants_supportdir)s/ivy/ivysettings_for_publishing.xml

[ivy]
# We need a custom ivy profile to grab the optional pgp libs for
# signing artifacts we publish to maven central.
ivy_profile: %(pants_supportdir)s/ivy/ivy.xml

[jvm-platform]
default_platform: java8
platforms: {
    'java7': {'source': '7', 'target': '7', 'args': [] },
    'java8': {'source': '8', 'target': '8', 'args': [] },
  }

Any idea what I’m missing?

calm-artist-46894

01/03/2020, 7:15 AM

Hi, is there a way to filter target by type when build? Something like this:

./pants binary :: --filter-type=python_library

Or is there a way to pipe the result from

./pants filter

to the net goal?

plain-sundown-25537

01/03/2020, 7:44 AM

you just want to run python?

calm-artist-46894

01/03/2020, 7:51 AM

For now, yes

plain-sundown-25537

01/03/2020, 7:51 AM

binary.py <--

calm-artist-46894

01/03/2020, 7:59 AM

it will still try to resolve all the

go

dependencies for non-python target

calm-artist-46894

01/03/2020, 8:01 AM

Copy code

23:58:37 00:00 [main]
               (To run a reporting server: ./pants server)
23:59:03 00:26   [setup]
23:59:04 00:27     [parse]
               Executing tasks in goals: unpack-wheels -> deferred-sources -> native-compile -> link -> resolve -> gen -> pyprep -> compile -> binary
23:59:04 00:27   [unpack-wheels]
23:59:04 00:27     [unpack-wheels]
23:59:04 00:27   [deferred-sources]
23:59:04 00:27     [deferred-sources]
23:59:04 00:27   [native-compile]
23:59:04 00:27     [conan-prep]
23:59:04 00:27     [conan-fetch]
23:59:04 00:27     [c-for-ctypes]
23:59:04 00:27     [cpp-for-ctypes]
23:59:04 00:27   [link]
23:59:04 00:27     [shared-libraries]
23:59:04 00:27   [resolve]
23:59:04 00:27     [go]
23:59:04 00:27       [cache]
                   No cached artifacts for 60 targets.
                   Invalidated 60 targets.
23:59:05 00:28       [fetch <http://cloud.google.com/go/bigquery]07:59:05|cloud.google.com/go/bigquery]07:59:05> [INFO] Cloning <https://code.googlesource.com/gocloud> into /tmp/tmpnz7pyg6v
Cloning into '/tmp/tmpnz7pyg6v'...

And I would like to skip the

resolve.go

task

calm-artist-46894

01/03/2020, 8:02 AM

It won’t impact the execution result, but may speed up the execution

plain-sundown-25537

01/03/2020, 9:45 AM

user

explain

you can see the steps

happy-kitchen-89482

01/04/2020, 2:51 PM

Can someone give context for https://github.com/pantsbuild/flake8-pantsbuild? Thanks

freezing-xylophone-6667

01/06/2020, 9:20 PM

Hey pants team, I’ve started learning pants recently and I’m attempting to setup a simple finatra project. I’ve noticed I’ve had a hard time including test jars in my 3rdparty dependency BUILD file. I haven’t had a lot of luck understanding how to scope the jars correctly. I’m hoping it’s something really simple that I’m missing. In

3rdparty/jvm/BUILD

I have the following:

Copy code

jar_library(
  name="finatratests",
  jars=[
    scala_jar(org='org.scalatest', name='scalatest', rev='3.0.0'),
    scala_jar(org='com.twitter', name='inject-server', rev='19.12.0'),
    scala_jar(org='com.twitter', name='inject-app', rev='19.12.0'),
    scala_jar(org='com.twitter', name='inject-core', rev='19.12.0'),
    scala_jar(org='com.twitter', name='inject-modules', rev='19.12.0'),
  ],
  scope="compile test",
)

However, even though I set

scope="compile test"

it’s not pulling in the test version of the jars. I’ve attempted to append

-tests

to the artifact name and to the rev number to see if that would do it, but the generated path URL is incorrect when I do that. In SBT I’d do the following with the

tests

classifier:

Copy code

libraryDependencies += "com.twitter" %% "inject-server" % versions.finatra % "test" classifier "tests"

Any help would be great! Thanks!

best-nightfall-7221

01/06/2020, 10:29 PM

Hi, I'm on pants 1.16 and running lint on some thrift and seeing this in the log. It doesnt actually fail the operation, but I'm wondering if its skipping out on actually linting https://gist.github.com/MasterDDT/898fa19755bf791adb2ac87fa59bc2e1

Copy code

Error: Unknown option --fatal-warnings
   Usage: scrooge-linter [options] <files...>

damp-quill-59187

01/07/2020, 7:19 PM

Hey all, Happy New Year. Have a quick question on some of the inner workings of Pants plugins. Is there a way to attach data to a pants target in flight? For example: Let's say I make a new task

run

which operates on a python_library target.

run

is set up to require

publish

, publish does it's magic and produces an artifact, and within

publish

a string is produced that needs to be associated with that particular library target for

run

. Is there a standardized way to make that association, such that it can be accessed on the target when

run

is executed?