pantsbuild #general

Yeah. The perm denied is either lack of privilege to fork/exec or lack of privilege to the file you're trying to execute. Not much wiggle room outside that.

jolly-midnight-72759

11/10/2020, 6:58 PM

Going to take notes in this thread. I was able to reproduce this with the example repo (

pantsbuild/example-python

) on my ec2 box:

Copy code

buildkite-agent@raulcicd:~/builds/foo/example-python$ ps aux | grep [p]antsd
buildki+  3339  0.3  2.3 260008 46528 ?        Sl   13:54   0:00 pantsd [/var/lib/buildkite-agent/builds/foo/example-python]
buildkite-agent@raulcicd:~/builds/foo/example-python$ kill 3339
buildkite-agent@raulcicd:~/builds/foo/example-python$ ./pants -ldebug list ::
Scrubbed PYTHONPATH=/home/ubuntu/superfly from the environment.
13:57:19.52 [DEBUG] acquiring lock: <pants.process.lock.OwnerPrintingInterProcessFileLock object at 0x7f65b92f0470>
13:57:19.53 [DEBUG] purging metadata directory: /var/lib/buildkite-agent/builds/foo/example-python/.pids/pantsd
13:57:19.53 [DEBUG] Launching pantsd
13:57:19.53 [DEBUG] purging metadata directory: /var/lib/buildkite-agent/builds/foo/example-python/.pids/pantsd
13:57:19.53 [DEBUG] pantsd command is: PANTS_ENTRYPOINT=pants.pantsd.pants_daemon:launch_new_pantsd_instance PYTHONPATH=/var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/pants.gUms69/install/bin:/home/ubuntu/superfly:/var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/2.0.0_py36/lib/python36.zip:/var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/2.0.0_py36/lib/python3.6:/var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/2.0.0_py36/lib/python3.6/lib-dynload:/usr/lib/python3.6:/var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/2.0.0_py36/lib/python3.6/site-packages /var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/2.0.0_py36/bin/python /var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/2.0.0_py36/bin/pants --pants-bin-name=./pants --pants-version=2.0.0 -ldebug list ::
13:57:20.23 [DEBUG] pantsd is running at pid 6001, pailgun port is 40237
13:57:20.23 [DEBUG] releasing lock: <pants.process.lock.OwnerPrintingInterProcessFileLock object at 0x7f65b92f0470>
13:57:20.23 [DEBUG] connecting to pantsd on port 40237 (attempt 1/3)
Failed to launch child `/var/lib/buildkite-agent/.cache/pants/setup/bootstrap-Linux-x86_64/2.0.0_py36/bin/pants`: Os { code: 13, kind: PermissionDenied, message: "Permission denied" }
buildkite-agent@raulcicd:~/builds/foo/example-python$ ps aux | grep [p]antsd
buildki+  6001 13.4  2.3 260008 47060 ?        Sl   13:57   0:00 pantsd [/var/lib/buildkite-agent/builds/foo/example-python]

jolly-midnight-72759

11/10/2020, 8:45 PM

Sweet. I was able to reproduce with your

Dockerfile

wooden-thailand-8386

11/10/2020, 9:05 PM

hey qq, anytime I run

./pants run projects/myproject::

it really wants to resolve the

constraints.txt

which takes… 500+ seconds… but if I use

./pants package

the first run is slower but then it’s super fast.. something weird or is this expected?

jolly-midnight-72759

11/10/2020, 11:30 PM

I think I found a missing step in the

1 -> 2

documentation. Our existing

python_requirement_library

entries look like this:

Copy code

python_requirement_library(
    name = "numpy15",
    requirements = [
            python_requirement("numpy==1.15.4"),
    ],
)

The docs [ https://www.pantsbuild.org/docs/python-third-party-dependencies#defining-inline-requirements ] say that

requirements = ["numpy==1.15.4"]

is the correct format. I'm also getting the following error:

Name 'python_requirement' is not defined

hundreds-father-404

11/11/2020, 10:34 PM

https://pantsbuild.slack.com/archives/CASMF8SJ1/p1605134021218600

wonderful-iron-54019

11/13/2020, 5:39 PM

Hi friends! this is most likely a lazy question but, we just migrated a part of our build flow from v1 -> v2 and have started to receive an error when there are no targets that match the given rule, anyway to ignore that error? Example error in thread

billowy-motherboard-58443

11/13/2020, 6:37 PM

@witty-crayon-22786 how long do you expect that survey to remain open?

wooden-thailand-8386

11/13/2020, 7:34 PM

Hey folks, I’ve been trying to make my monorepo look more like the structure of

pants

repo, by removing the “regular” python-package structure like:

Copy code

projects/
  my_project/
    my_project/
      __init__.py
      __main__.py
    pyproject.toml
    README.md

so I dont have that inner

my_project

anymore, nor I’m using the

pyproject.toml

to define that package… the thing is, now my

pex_binary()

creates the whole structure ->

projects/my_project/__main__.py

instead what it was doing before by putting

my_project

directly into the root of the pex. I’m pretty sure this is something very very silly I’m doing with the

python_libraries()

definitions / BUILD files. How can I make sure that

my_project

lives at the root of the

pex

file so I can set the entry_point as

my_project

instead of

<http://projects.my|projects.my>_project

witty-crayon-22786

11/13/2020, 7:52 PM

bump! https://pantsbuild.slack.com/archives/C046T6T9U/p1605292032321000?thread_ts=1604600533.210200&cid=C046T6T9U

loud-stone-83419

11/13/2020, 8:02 PM

Hi! I am considering using pants for our codebase that is scala / typescript / python and I see that pants 2 is going to provide scala / java support coming soon. Is there a projected timeline? This document was hinting that a date might have been discussed but I can't find it anywhere https://docs.google.com/document/d/1JgybVPtadftK0UXxmSdzmfTr8PmEvYwR2edwonHP66k/edit#heading=h.zdh8s1kla2rg 🙂

loud-stone-83419

11/13/2020, 8:02 PM

Happy to test betas 😛

loud-stone-83419

11/13/2020, 8:03 PM

Just saw the message above - I guess I will participate to the form

❤️ 2

user

11/13/2020, 10:20 PM

https://twitter.com/pantsbuild/status/1327375876313411584 We're in the final stages of a prioritization effort to see what the community needs most from Pants post 2.0.0! If you're a past, present, or future Pants user, we'd love to get your input on the highest priority work for the project!: https://t.co/D5tkzJrT2i Twitter

plain-sundown-25537

11/16/2020, 2:57 AM

Is pants doing something on ulimit_n on Mac OS?

Copy code

❯ ipython
Python 3.7.5 (default, Dec 26 2019, 04:25:18)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.11.1 -- An enhanced Interactive Python. Type '?' for help.
In [1]: import jedi
In [2]: import resource
In [3]: resource
Out[3]: <module 'resource' from '/Users/leozc/.pyenv/versions/3.7.5/lib/python3.7/lib-dynload/resource.cpython-37m-darwin.so'>
In [4]: resource.getrlimit(resource.RLIMIT_NOFILE)
Out[4]: (65536, 9223372036854775807) 
in sandbox

While kick the run in pants

Copy code

❯ ./pants repl helloworld/rayburst.py #my own app
Python 3.7.5 (default, Dec 26 2019, 04:25:18)
[Clang 11.0.0 (clang-1100.0.33.8)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
(InteractiveConsole)
>>> import resource
>>> resource.getrlimit(resource.RLIMIT_NOFILE)
(9223372036854775807, 9223372036854775807)

❯ ./pants --version 185817.15 [INFO] initializing pantsd... 185817.89 [INFO] pantsd initialized. 2.1.0rc0

calm-ambulance-65371

11/16/2020, 4:45 PM

Is there any bash completion available for pants 2?

witty-crayon-22786

11/16/2020, 6:08 PM

bump!: https://pantsbuild.slack.com/archives/C046T6T9U/p1605292032321000?thread_ts=1604600533210200&cid=C046T6T9U

jolly-midnight-72759

11/16/2020, 7:22 PM

Problem: I want our CICD tool to kick off a project pipeline when

./pants --changed-since="${REF}"

contains that pipeline. If multiple project pipelines have changed, then multiple triggers will be fired. The atomic unit of v2 is the file. So that implies that when looking at the output of

change-since

, the tool needs to create a list of all the projects involved then fire the triggers. That begs two questions: * How do I define a project? * How do I map a file to a project?

clean-night-52582

11/17/2020, 12:16 AM

If I was to set up Remote Execution for pants is there a recommendation for which solution to choose? A requirement would we would want to host in on-prem, but it seems that the three options listed can be used that way.

fast-nail-55400

11/17/2020, 12:32 AM

If I was to set up Remote Execution for pants is there a recommendation for which solution to choose? A requirement would we would want to host in on-prem, but it seems that the three options listed can be used that way.

fast-nail-55400

11/17/2020, 12:33 AM

Basically the choice is up to you. Each project has its pros and cons.

fast-nail-55400

11/17/2020, 12:34 AM

Want to discuss in #remoting?

clean-night-52582

11/17/2020, 12:34 AM

Sure

witty-crayon-22786

11/17/2020, 6:39 PM

it is once again time for me to… bump this!: https://pantsbuild.slack.com/archives/C046T6T9U/p1605292032321000?thread_ts=1604600533210200&cid=C046T6T9U

polite-vase-75369

11/17/2020, 7:31 PM

Does the junit test shard parameter do anything? Or am I on a bad version of pants?