Hi We still have trouble with running pants in a python subp

Question

Hi We still have trouble with running pants in a python subprocess Some new findings 1 It looks like `pantsd` isn t being re used We get ```17 26 09 72 INFO Initializing scheduler 17 26 09 85 INFO Scheduler initialized ``` repeatedly for subprocesses 2 It looks like python2 7 is used for some pex unzip thingy Is this expected 3 We re having cache misses everytime the subprocess is rerun Could it be due to pyenv XDG CACHE HOME DIR or something else It s hard to figure out what settings causes pants to disregard its cache

bitter-ability-32190 · Answer

For 1 It s useful to check ` pants d pants log` to see what `inotify` is telling pants has changed

worried-painter-31382 · Answer

Ill just add that the subprocesses are ran serially

bitter-ability-32190 · Answer

For 3 Running with ` ldebug` and looking for Running Process Log lines and comparing like elements across runs can help identify what inputs have changed

happy-kitchen-89482 · Answer

To clarify you re spawning pants itself from python using `subprocess` or similar

happy-kitchen-89482 · Answer

And re 2 can you post the output that mentions 2 7

bitter-ability-32190 · Answer

Actually for 1 the log helps But if a file changes the daemon doesn t restart I was misremembering Usually I ve seen this happen if you exceed the memory cache limits

worried-painter-31382 · Answer

Exactly right < happy kitchen 89482> Timezones wont let me check in like 14 hrs sweat smile but Ill post here ASAP regarding the pex unzip python2 7 thing

happy-kitchen-89482 · Answer

Hmm and you don t have that same problem of the daemon restarting if you run ` pants` directly from the shell

happy-kitchen-89482 · Answer

I ve tried to naively reproduce using `subprocess` in a repl and I don t see the issue happening

worried-painter-31382 · Answer

I ll see if I can reproduce from memory how our machines are setup but my uneducated suspicion is the subprocess losing pyenv and cache dir

worried-painter-31382 · Answer

And no pantsd issues are isolated to subprocess

bitter-ability-32190 · Answer

Is the cwd the same across subprocess runs Pants stores the daemon PID relative to cwd

worried-painter-31382 · Answer

That is a good tip

worried-painter-31382 · Answer

` ldebug` for the different invocations `app py` runs ```subprocess run str pants path ldebug package str dockerfile dynamic ui=False text=True ``` ``` pants package lt snip gt 20 08 06 55 DEBUG acquiring lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f8c4aae53a0 gt 20 08 06 55 DEBUG releasing lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f8c4aae53a0 gt 20 08 06 55 DEBUG Connecting to pantsd on port 43245 20 08 06 55 DEBUG Connecting to pantsd on port 43245 attempt 1 3 20 08 06 55 DEBUG Connected to pantsd 20 08 06 57 DEBUG Launching 1 roots poll=false 20 08 06 57 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 20 08 06 58 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 20 08 06 58 DEBUG Dependency rule pants engine internals options parsing scope options of Some rule construct scope changed 20 08 06 58 DEBUG Dependency rule construct scope of Some rule pants init plugin resolver resolve plugins changed 20 08 06 58 DEBUG computed 1 nodes in 0 011746 seconds there are 7 total nodes 20 08 06 60 INFO Initialization options changed reinitializing scheduler ``` ```$ python app py 20 11 17 27 DEBUG acquiring lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f1555c3f580 gt 20 11 17 27 DEBUG releasing lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f1555c3f580 gt 20 11 17 27 DEBUG Connecting to pantsd on port 43245 20 11 17 27 DEBUG Connecting to pantsd on port 43245 attempt 1 3 20 11 17 27 DEBUG masking tcgetattr exception error 25 Inappropriate ioctl for device 20 11 17 28 DEBUG Connected to pantsd 20 11 17 31 DEBUG Launching 1 roots poll=false 20 11 17 31 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 20 11 17 32 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 20 11 17 32 DEBUG Dependency rule pants engine internals options parsing scope options of Some rule construct scope changed 20 11 17 32 DEBUG Dependency rule construct scope of Some rule pants init plugin resolver resolve plugins changed 20 11 17 32 DEBUG computed 1 nodes in 0 010312 seconds there are 7 total nodes 20 11 17 35 INFO Initialization options changed reinitializing scheduler ```

bitter-ability-32190 · Answer

I don t see any process runs in there eyes

worried-painter-31382 · Answer

I though the issue would materialize from the decisions pants is doing Initialization options changed reinitializing schedule seems to me like pants has decided to restart the daemon and it invalidates the cache based on some options Im very curious what causes it to for example think the plugins have changed between these invocations notice the `20 11 17 32 DEBUG Dependency rule construct scope of Some rule pants init plugin resolver resolve plugins changed `

bitter-ability-32190 · Answer

What s your plugin list look like

worried-painter-31382 · Answer

``` GLOBAL pythonpath = buildroot s pants plugins pants version = 2 13 0 backend packages = pants backend python pants backend docker hash source root patterns = ```

bitter-ability-32190 · Answer

Nothing screams at me but I m less adept here face with diagonal mouth

bitter-ability-32190 · Answer

< witty crayon 22786>

worried-painter-31382 · Answer

hmm There s a ` pycache ` directory in the plugin folder

bitter-ability-32190 · Answer

That doesn t seem unexpected

bitter-ability-32190 · Answer

The code does get executed from source

worried-painter-31382 · Answer

I guess not was unsure how `pants ignore` worked but read it again it s gitignore

worried-painter-31382 · Answer

removing our custom plugins changed nothing

worried-painter-31382 · Answer

```python app py 21 40 59 89 DEBUG acquiring lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f471b174eb0 gt 21 40 59 90 DEBUG releasing lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f471b174eb0 gt 21 40 59 90 DEBUG Connecting to pantsd on port 35825 21 40 59 90 DEBUG Connecting to pantsd on port 35825 attempt 1 3 21 40 59 90 DEBUG Connected to pantsd 21 40 59 93 DEBUG Launching 1 roots poll=false 21 40 59 94 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 21 40 59 95 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 21 40 59 95 DEBUG computed 1 nodes in 0 010659 seconds there are 7 total nodes 21 40 59 97 DEBUG Launching 1 roots poll=false 21 40 59 97 DEBUG computed 1 nodes in 0 000277 seconds there are 7 total nodes 21 41 00 00 DEBUG specs are Specs includes=RawSpecs description of origin= CLI arguments address literals= file literals= FileLiteralSpec file= cloud deployment jwk cacher Dockerfile file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=True from change detection=False ignores=RawSpecs description of origin= CLI arguments address literals= file literals= file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=False from change detection=False 21 41 00 00 DEBUG changed options are ChangedOptions since=None diffspec=None dependees= lt DependeesOption NONE none gt 21 41 00 00 DEBUG Launching 1 roots poll=false 21 41 00 00 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 21 41 00 00 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 21 41 00 00 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 21 41 00 01 DEBUG computed 1 nodes in 0 001878 seconds there are 818 total nodes 21 41 00 01 DEBUG requesting lt class pants backend project info list targets List gt to satisfy execution of `list` goal 21 41 00 01 DEBUG Launching 1 roots poll=false 21 41 00 01 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 21 41 00 01 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 21 41 00 01 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 21 41 00 01 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed cloud deployment jwk cacher jwk cacher 21 41 00 01 DEBUG Completed `list` goal 21 41 00 01 DEBUG computed 1 nodes in 0 007508 seconds there are 820 total nodes ``` ``` pants list ldebug home tobias projects profiler cloud deployment jwk cacher Dockerfile 21 43 40 79 DEBUG acquiring lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f2d66691e20 gt 21 43 40 79 DEBUG releasing lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f2d66691e20 gt 21 43 40 79 DEBUG Connecting to pantsd on port 35825 21 43 40 80 DEBUG Connecting to pantsd on port 35825 attempt 1 3 21 43 40 80 DEBUG Connected to pantsd 21 43 40 81 DEBUG Launching 1 roots poll=false 21 43 40 81 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 21 43 40 82 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 21 43 40 82 DEBUG Dependency rule pants engine internals options parsing scope options of Some rule construct scope changed 21 43 40 82 DEBUG Dependency rule construct scope of Some rule pants init plugin resolver resolve plugins changed 21 43 40 82 DEBUG computed 1 nodes in 0 014019 seconds there are 7 total nodes 21 43 40 85 INFO Initialization options changed reinitializing scheduler 21 43 40 85 DEBUG terminating pantsd service lt pants pantsd service scheduler service SchedulerService object at 0x7eee74368dc0 gt 21 43 41 27 DEBUG terminating pantsd service lt pants pantsd service store gc service StoreGCService object at 0x7eee74365040 gt 21 43 41 27 DEBUG File handle limit is 10000 21 43 41 27 DEBUG Using cache CommandRunner inner bounded CommandRunner inner nailgun CommandRunner inner local CommandRunner cache CommandRunner inner bounded CommandRunner inner nailgun CommandRunner inner local CommandRunner for process execution 21 43 41 37 DEBUG Changes to home tobias cache pants setup bootstrap Linux x86 64 pants QA6V74 install bin outside of the buildroot will not be invalidated 21 43 41 37 DEBUG Changes to home tobias cache pants setup bootstrap Linux x86 64 pants QA6V74 install bin outside of the buildroot will not be invalidated 21 43 41 37 DEBUG Changes to home tobias pyenv versions 3 9 13 lib python39 zip outside of the buildroot will not be invalidated 21 43 41 37 DEBUG Changes to home tobias pyenv versions 3 9 13 lib python3 9 outside of the buildroot will not be invalidated 21 43 41 37 DEBUG Changes to home tobias pyenv versions 3 9 13 lib python3 9 lib dynload outside of the buildroot will not be invalidated 21 43 41 37 DEBUG Changes to home tobias cache pants setup bootstrap Linux x86 64 2 13 0 py39 lib python3 9 site packages outside of the buildroot will not be invalidated 21 43 41 37 DEBUG setting up service lt pants pantsd service scheduler service SchedulerService object at 0x7eecce188820 gt 21 43 41 37 DEBUG setting up service lt pants pantsd service store gc service StoreGCService object at 0x7eecce188a60 gt 21 43 41 37 DEBUG starting service lt pants pantsd service scheduler service SchedulerService object at 0x7eecce188820 gt 21 43 41 38 DEBUG starting service lt pants pantsd service store gc service StoreGCService object at 0x7eecce188a60 gt 21 43 41 38 INFO Scheduler initialized 21 43 41 38 DEBUG Launching 1 roots poll=false 21 43 41 38 DEBUG computed 1 nodes in 0 000405 seconds there are 7 total nodes 21 43 41 42 DEBUG specs are Specs includes=RawSpecs description of origin= CLI arguments address literals= file literals= FileLiteralSpec file= cloud deployment jwk cacher Dockerfile file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=True from change detection=False ignores=RawSpecs description of origin= CLI arguments address literals= file literals= file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=False from change detection=False 21 43 41 42 DEBUG changed options are ChangedOptions since=None diffspec=None dependees= lt DependeesOption NONE none gt 21 43 41 42 DEBUG Launching 1 roots poll=false 21 43 41 42 DEBUG computed 1 nodes in 0 002089 seconds there are 17 total nodes 21 43 41 42 DEBUG requesting lt class pants backend project info list targets List gt to satisfy execution of `list` goal 21 43 41 42 DEBUG Launching 1 roots poll=false 21 43 41 42 DEBUG Completed Find targets from input specs 21 43 41 56 DEBUG Completed Generate `python requirement` targets from requirements txt 21 43 41 72 DEBUG Completed Find targets from input specs 21 43 41 72 DEBUG Completed Find targets from input specs cloud deployment jwk cacher jwk cacher 21 43 41 72 DEBUG Completed `list` goal 21 43 41 72 DEBUG computed 1 nodes in 0 298842 seconds there are 818 total nodes ```

worried-painter-31382 · Answer

full runs just running the `list` goal for some target once via bash and once via python subprocess

worried-painter-31382 · Answer

I still dont understand what is causing pants to not like the pantsd that is running but have to restart it everytime python subprocess is ran

bitter-ability-32190 · Answer

We ll hold on when you run the list command twice it should reuse the daemon Passing ldebug changes the bootstrap options so restarts the daemon

bitter-ability-32190 · Answer

I m also on mobile so I might ve missed something

witty-crayon-22786 · Answer

gt ```20 08 06 60 INFO Initialization options changed reinitializing scheduler ``` suggests that a bootstrap `daemon=True` option an even smaller set of options has changed between runs

witty-crayon-22786 · Answer

if the CLI args are all consistent the most likely culprit and you re not changing `pants toml` the next thing to check would just be whether some env vars are changing between runs

witty-crayon-22786 · Answer

as Josh said a run with ` ldebug` and then another without will cause the scheduler to invalidate because ` level` ` l` are bootstrap options

witty-crayon-22786 · Answer

so yea would look at the CLI args in each run and then probably the env in each run and look for differences in which option values are being set

worried-painter-31382 · Answer

` pants list requirements txt ldebug amp amp python c import subprocess subprocess run home tobias projects profiler pants list requirements txt ldebug ` ```22 02 16 94 DEBUG acquiring lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7fcc41e96cd0 gt 22 02 16 94 DEBUG releasing lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7fcc41e96cd0 gt 22 02 16 94 DEBUG Connecting to pantsd on port 38351 22 02 16 95 DEBUG Connecting to pantsd on port 38351 attempt 1 3 22 02 16 95 DEBUG Connected to pantsd 22 02 16 96 DEBUG Launching 1 roots poll=false 22 02 16 96 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 22 02 16 97 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 22 02 16 97 DEBUG computed 1 nodes in 0 011350 seconds there are 7 total nodes 22 02 17 00 DEBUG Launching 1 roots poll=false 22 02 17 00 DEBUG computed 1 nodes in 0 000408 seconds there are 7 total nodes 22 02 17 03 DEBUG specs are Specs includes=RawSpecs description of origin= CLI arguments address literals= file literals= FileLiteralSpec file= requirements txt file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=True from change detection=False ignores=RawSpecs description of origin= CLI arguments address literals= file literals= file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=False from change detection=False 22 02 17 03 DEBUG changed options are ChangedOptions since=None diffspec=None dependees= lt DependeesOption NONE none gt 22 02 17 03 DEBUG Launching 1 roots poll=false 22 02 17 03 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 22 02 17 03 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 22 02 17 03 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 22 02 17 03 DEBUG computed 1 nodes in 0 002203 seconds there are 747 total nodes 22 02 17 03 DEBUG requesting lt class pants backend project info list targets List gt to satisfy execution of `list` goal 22 02 17 03 DEBUG Launching 1 roots poll=false 22 02 17 03 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 22 02 17 03 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 22 02 17 03 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 22 02 17 04 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed requirements file requirements txt requirements 22 02 17 04 DEBUG Completed `list` goal 22 02 17 04 DEBUG computed 1 nodes in 0 007651 seconds there are 749 total nodes 22 02 17 95 DEBUG acquiring lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f8fb8e81070 gt 22 02 17 95 DEBUG releasing lock lt pants pantsd lock OwnerPrintingInterProcessFileLock object at 0x7f8fb8e81070 gt 22 02 17 95 DEBUG Connecting to pantsd on port 38351 22 02 17 95 DEBUG Connecting to pantsd on port 38351 attempt 1 3 22 02 17 95 DEBUG Connected to pantsd 22 02 17 96 DEBUG Launching 1 roots poll=false 22 02 17 96 DEBUG Dependency SessionValues of Some rule pants engine internals options parsing parse options changed 22 02 17 97 DEBUG Dependency rule pants engine internals options parsing parse options of Some rule pants engine internals options parsing scope options changed 22 02 17 97 DEBUG Dependency rule pants engine internals options parsing scope options of Some rule construct scope changed 22 02 17 97 DEBUG Dependency rule construct scope of Some rule pants init plugin resolver resolve plugins changed 22 02 17 97 DEBUG computed 1 nodes in 0 011941 seconds there are 7 total nodes 22 02 18 00 INFO Initialization options changed reinitializing scheduler 22 02 18 00 DEBUG terminating pantsd service lt pants pantsd service scheduler service SchedulerService object at 0x7fadef40ea60 gt 22 02 18 13 DEBUG terminating pantsd service lt pants pantsd service store gc service StoreGCService object at 0x7fadef097d60 gt 22 02 18 14 DEBUG File handle limit is 10000 22 02 18 14 DEBUG Using cache CommandRunner inner bounded CommandRunner inner nailgun CommandRunner inner local CommandRunner cache CommandRunner inner bounded CommandRunner inner nailgun CommandRunner inner local CommandRunner for process execution 22 02 18 24 DEBUG Changes to home tobias cache pants setup bootstrap Linux x86 64 pants QA6V74 install bin outside of the buildroot will not be invalidated 22 02 18 24 DEBUG Changes to home tobias cache pants setup bootstrap Linux x86 64 pants QA6V74 install bin outside of the buildroot will not be invalidated 22 02 18 24 DEBUG Changes to home tobias pyenv versions 3 9 13 lib python39 zip outside of the buildroot will not be invalidated 22 02 18 24 DEBUG Changes to home tobias pyenv versions 3 9 13 lib python3 9 outside of the buildroot will not be invalidated 22 02 18 24 DEBUG Changes to home tobias pyenv versions 3 9 13 lib python3 9 lib dynload outside of the buildroot will not be invalidated 22 02 18 24 DEBUG Changes to home tobias cache pants setup bootstrap Linux x86 64 2 13 0 py39 lib python3 9 site packages outside of the buildroot will not be invalidated 22 02 18 24 DEBUG setting up service lt pants pantsd service scheduler service SchedulerService object at 0x7f6ac0e80cd0 gt 22 02 18 24 DEBUG setting up service lt pants pantsd service store gc service StoreGCService object at 0x7f6ac0e80f10 gt 22 02 18 24 DEBUG starting service lt pants pantsd service scheduler service SchedulerService object at 0x7f6ac0e80cd0 gt 22 02 18 24 DEBUG starting service lt pants pantsd service store gc service StoreGCService object at 0x7f6ac0e80f10 gt 22 02 18 24 INFO Scheduler initialized 22 02 18 24 DEBUG Launching 1 roots poll=false 22 02 18 24 DEBUG computed 1 nodes in 0 000525 seconds there are 7 total nodes 22 02 18 28 DEBUG specs are Specs includes=RawSpecs description of origin= CLI arguments address literals= file literals= FileLiteralSpec file= requirements txt file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=True from change detection=False ignores=RawSpecs description of origin= CLI arguments address literals= file literals= file globs= dir literals= dir globs= recursive globs= ancestor globs= unmatched glob behavior= lt GlobMatchErrorBehavior error error gt filter by global options=False from change detection=False 22 02 18 28 DEBUG changed options are ChangedOptions since=None diffspec=None dependees= lt DependeesOption NONE none gt 22 02 18 28 DEBUG Launching 1 roots poll=false 22 02 18 28 DEBUG computed 1 nodes in 0 002242 seconds there are 22 total nodes 22 02 18 28 DEBUG requesting lt class pants backend project info list targets List gt to satisfy execution of `list` goal 22 02 18 28 DEBUG Launching 1 roots poll=false 22 02 18 29 DEBUG Completed Find targets from input specs 22 02 18 44 DEBUG Completed Generate `python requirement` targets from requirements txt 22 02 18 53 DEBUG Completed Find targets from input specs 22 02 18 53 DEBUG Completed Find targets from input specs requirements file requirements txt requirements 22 02 18 53 DEBUG Completed `list` goal 22 02 18 54 DEBUG computed 1 nodes in 0 251346 seconds there are 743 total nodes ```

worried-painter-31382 · Answer

So it must be env variables then

witty-crayon-22786 · Answer

seems likely yea whether the output is a TTY should no longer invalidate the scheduler

witty-crayon-22786 · Answer

and to be clear this is about your question 1 although env vars can definitely also impact your question 3

worried-painter-31382 · Answer

Would a different PATH cause this I notice pyenv shims append stuff to path before entering python

witty-crayon-22786 · Answer

yes a different PATH would definitely cause 3

witty-crayon-22786 · Answer

it should not cause 1

worried-painter-31382 · Answer

gt it should not cause 1 Seems it doesn t I ve circumvented pyenv and it still happens

worried-painter-31382 · Answer

I ve reduced the whole thing to pants toml ``` GLOBAL pants version = 2 13 0 backend packages = pants backend python ``` BUILD `````` src main py ```print Hello world ``` src BUILD ```python sources ``` Just to sanity check it still occurs that the daemon is restarted when running ` pants list src main py ldebug amp amp python c import subprocess subprocess run home tobias projects dummy pants list src main py ldebug `

worried-painter-31382 · Answer

Is there some way I can render the options pants is detecting to change between these two

witty-crayon-22786 · Answer

could dump out and diff ` pants help all` tons of JSON although note that there is apparently some non determinism in there which shouldn t impact anything aside from making your diff noisy

worried-painter-31382 · Answer

``` details from env var PANTS BIN NAME rank ENVIRONMENT value home tobias projects dummy pants ``` ``` details from env var PANTS BIN NAME rank ENVIRONMENT value pants ```

bitter-ability-32190 · Answer

Ah yeah that makes sense It s the difference between invoking the wrapper script and invoking the code directly FWIW you can set that in pants toml see if that helps

witty-crayon-22786 · Answer

that could indeed do it all bootstrap options are fingerprinted unless they opt out with `fingerprint=False` <https github com pantsbuild pants blob 9a6dc0069bcd56e0bfd1b4445ff40674b99d41ae src python pants option global options py L774 L779>

worried-painter-31382 · Answer

It does seem to be the culprit sweat smile

worried-painter-31382 · Answer

gt Ah yeah that makes sense It s the difference between invoking the wrapper script and invoking the code directly gt FWIW you can set that in pants toml see if that helps The script invocation seem to override it unfortunately

worried-painter-31382 · Answer

Buut I can work with this as long as `cwd` of the subprocess is repo root ` pants` should be ok and we already estabillished cwd should be repo root anyway because of pantsd dirs

bitter-ability-32190 · Answer

If you unconditionally set it to pants does that work The script overrides it with the same value

worried-painter-31382 · Answer

gt If you unconditionally set it to pants does that work If you mean in `pants toml` the awnser is no

bitter-ability-32190 · Answer

Hm shame

worried-painter-31382 · Answer

Just wanted to reconnect here The bin name var was part of the reason for restarts the other was pantsd running out of its 1GiB memory

worried-painter-31382 · Answer

The python2 7 thing was a pyenv vs system python issue

happy-kitchen-89482 · Answer

Thanks for the update So are things working now

bitter-ability-32190 · Answer

Have you found the setting to change the daemon memory size Look in the global options sorry on mobile