pantsbuild #general

Heads up: I am preparing to send a quick mini survey about jdk usage in the community (simple questions: which jdk version do you use, which scala version do you use), motivated by https://github.com/sbt/util/issues/75

👍 2

plain-sundown-25537

04/04/2017, 7:57 PM

Hello friends,

Copy code

Unexpected problem writing target jar /home/sean/repos/webapp/monorepo/.pants.d/bootstrap/bootstrap-jvm-tools/tool_cache/binary_jars/org.pantsbuild.tools.junit.ConsoleRunner-ae1b8c9f8158f4c6ccf6ad417602ae498d7dd852-ShadedToolFingerprintStrategy_53c4bb9c6553.jar: java.io.IOException: File name too long

when running test

plain-sundown-25537

04/04/2017, 7:58 PM

any good way to work around this?

gifted-beard-62952

04/04/2017, 8:06 PM

Hello everyone

gifted-beard-62952

04/04/2017, 8:07 PM

Am i understanding the 3rdparty

python_requirements()

that i actually need to download the code of the package and place it in the 3rdparty directory? because i don't see it doing any pip installs here.

gifted-beard-62952

04/04/2017, 8:08 PM

I am actually writing a backend_package which needs the

docker

python package to perform docker-related stuff

gifted-beard-62952

04/04/2017, 8:09 PM

my new target looks as follows:

Copy code

python_wheel(
    name='config',
    sources=rglobs('*.py'),
    dependencies=[
        '3rdparty/python:docker',
    ]
)

and in 3rdparty, i have 2 files (BUILD + requirements.txt) Edit: Pants version 1.2.1

witty-crayon-22786

04/04/2017, 8:13 PM

pants uses pex to create chroots containing your dependencies, so pip isn't involved

gifted-beard-62952

04/04/2017, 8:16 PM

@witty-crayon-22786 does pex do the package download on it's own? (sorry not familiar with pex's details yet)

full-kilobyte-93429

04/04/2017, 8:33 PM

@plain-sundown-25537 there was a similar report by whodat, was to do with encrypted file system, and one workaround is to set

'-S-Xmax-classfile-name'

, you can search "File name too long"

plain-sundown-25537

04/04/2017, 8:38 PM

@full-kilobyte-93429 let me try

witty-crayon-22786

04/04/2017, 8:47 PM

@gifted-beard-62952 : yes, it does

witty-crayon-22786

04/04/2017, 8:48 PM

a bit more info here: http://www.pantsbuild.org/python_readme.html#pex-contents

witty-crayon-22786

04/04/2017, 8:48 PM

and in http://www.pantsbuild.org/3rdparty_py.html

witty-crayon-22786

04/04/2017, 8:50 PM

@full-kilobyte-93429 : well, this looks like something at the python level cc @plain-sundown-25537

witty-crayon-22786

04/04/2017, 8:51 PM

it might require a patch to pants, because i don't know if that path gets any shorter.

witty-crayon-22786

04/04/2017, 8:56 PM

(is this in docker?)

gifted-beard-62952

04/04/2017, 9:03 PM

Thanks for the info... i decided to go the pants way and build using pex. After fixing my targets, here's what i get:

Copy code

No cached artifacts for 1 target.
                   Invalidated 1 target.**** Failed to install setuptools-5.4.1 (caused by: NonZeroExit("received exit code 1 during execution of `[u'/home/rakan/.pyenv/shims/python', '-', 'bdist_egg', '--dist-dir=/tmp/tmpjNHG0C']`",)
):
stdout:

stderr:
Traceback (most recent call last):
  File "<stdin>", line 5, in <module>
  File "setup.py", line 19, in <module>
    exec(init_file.read(), command_ns)
  File "<string>", line 11, in <module>
  File "/tmp/tmpvrR5qX/setuptools-5.4.1/setuptools/__init__.py", line 12, in <module>
    from setuptools.extension import Extension
  File "/tmp/tmpvrR5qX/setuptools-5.4.1/setuptools/extension.py", line 7, in <module>
    from setuptools.dist import _get_unpatched
  File "/tmp/tmpvrR5qX/setuptools-5.4.1/setuptools/dist.py", line 18, in <module>
    import pkg_resources
  File "/tmp/tmpvrR5qX/setuptools-5.4.1/pkg_resources.py", line 1520, in <module>
    register_loader_type(importlib_bootstrap.SourceFileLoader, DefaultProvider)
AttributeError: module 'importlib._bootstrap' has no attribute 'SourceFileLoader'



23:01:33 00:02   [complete]
               FAILURE
Exception caught: (<class 'pex.resolver.Untranslateable'>)

Exception message: Package SourcePackage(u'<https://pypi.python.org/packages/cb/55/4143b8a178e17c39c246d95dd0620e8c26c699ffc5267eb5d444b6b2429a/setuptools-5.4.1.tar.gz#md5=3540a44b90017cbb851840934156848e>') is not translateable by ChainedTranslator(EggTranslator, SourceTranslator)

gifted-beard-62952

04/04/2017, 9:04 PM

passing

-i="CPython>=3.5"

most-farmer-27910

04/04/2017, 9:30 PM

Hi all, I'm trying to create a jvm source jar. According to the help docs,

jar.create

will

Jar jvm libraries and optionally their sources and their docs.

I'm not seeing any options that specify to jar up sources (or docs for that matter). Any guidance?

witty-crayon-22786

04/04/2017, 9:31 PM

sources and docs should be included by default

most-farmer-27910

04/04/2017, 9:33 PM

hmm okay, I'll take a look at the output then. appreciate the help

witty-crayon-22786

04/04/2017, 9:34 PM

@most-farmer-27910 : easiest to just send it to a temporary directory and then inspect

witty-crayon-22786

04/04/2017, 9:34 PM

Copy code

yes | ./pants publish.jar --local=blah $target

witty-crayon-22786

04/04/2017, 9:35 PM

(note: literal "blah" there)

most-farmer-27910

04/04/2017, 9:41 PM

okay I'll give that a try. Where "blah" is a directory relative to the pants root?