how do I debug pants not finding the `black` confi...
# general
p
how do I debug pants not finding the
black
config in pyproject.toml? this is what I see:
this
2.8.0.dev5
h
Does it reproduce locally? Use --no-process-execution-local-cleanup and double check the chroot has pyproject.toml
p
Yes
Will try running with this option
pyproject.toml is the repo root.
same behavior with that option
Copy code
➜  posthog-foss git:(pants-manual-for-toolchain) ./pants --no-process-execution-local-cleanup lint posthog/api/::
18:30:01.48 [INFO] Initialization options changed: reinitializing scheduler...
18:30:02.09 [INFO] Scheduler initialized.
18:30:02.13 [WARN] DEPRECATED: the `requirements_relpath` argument for `python_requirements()` will be removed in version 2.9.0.dev0.

Use the `source` argument instead of `requirements_relpath` for the `python_requirements` macro in the BUILD file at . `source` behaves the same.
18:30:02.15 [WARN] DEPRECATED: the `requirements_relpath` argument for `python_requirements()` will be removed in version 2.9.0.dev0.

Use the `source` argument instead of `requirements_relpath` for the `python_requirements` macro in the BUILD file at . `source` behaves the same.
18:30:02.29 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionZxohvx for "Searching for `bash` on PATH=/usr/bin:/bin:/usr/local/bin"
18:30:02.47 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionszDtWu for "Test binary /bin/bash."
18:30:02.48 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution1DDo7D for "Searching for `python3` on PATH=/Users/asher/.pyenv/versions/2.7.14/bin:/Users/asher/.pyenv/versions/3.6.11/bin:/Users/asher/.pyenv/versions/3.7.4/bin:/Users/asher/.pyenv/versions/3.8.12/bin:/Users/asher/.pyenv/versions/3.8.9/bin:/Users/asher/.pyenv/versions/3.9.4/bin:/Users/asher/.nvm/versions/node/v12.16.3/bin:/Users/asher/.gem/ruby/2.6.0/bin/:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/Library/Apple/usr/bin:/Users/asher/.cargo/bin:/Users/asher/go/bin/:/Users/asher/.poetry/bin:/Users/asher/.krew/bin:/Users/asher/.local/bin"
18:30:02.48 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionWr4qB1 for "Searching for `python` on PATH=/Users/asher/.pyenv/versions/2.7.14/bin:/Users/asher/.pyenv/versions/3.6.11/bin:/Users/asher/.pyenv/versions/3.7.4/bin:/Users/asher/.pyenv/versions/3.8.12/bin:/Users/asher/.pyenv/versions/3.8.9/bin:/Users/asher/.pyenv/versions/3.9.4/bin:/Users/asher/.nvm/versions/node/v12.16.3/bin:/Users/asher/.gem/ruby/2.6.0/bin/:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/Library/Apple/usr/bin:/Users/asher/.cargo/bin:/Users/asher/go/bin/:/Users/asher/.poetry/bin:/Users/asher/.krew/bin:/Users/asher/.local/bin"
18:30:02.48 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionRmhRqr for "Searching for `python2` on PATH=/Users/asher/.pyenv/versions/2.7.14/bin:/Users/asher/.pyenv/versions/3.6.11/bin:/Users/asher/.pyenv/versions/3.7.4/bin:/Users/asher/.pyenv/versions/3.8.12/bin:/Users/asher/.pyenv/versions/3.8.9/bin:/Users/asher/.pyenv/versions/3.9.4/bin:/Users/asher/.nvm/versions/node/v12.16.3/bin:/Users/asher/.gem/ruby/2.6.0/bin/:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/Library/Apple/usr/bin:/Users/asher/.cargo/bin:/Users/asher/go/bin/:/Users/asher/.poetry/bin:/Users/asher/.krew/bin:/Users/asher/.local/bin"
18:30:02.59 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionfQC8ad for "Test binary /usr/bin/python3."
18:30:02.59 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionab8UWo for "Test binary /Users/asher/.pyenv/versions/3.6.11/bin/python3."
18:30:02.59 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionIYFdKh for "Test binary /Users/asher/.pyenv/versions/3.8.9/bin/python3."
18:30:02.59 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionhwia9P for "Test binary /Users/asher/.pyenv/versions/3.8.12/bin/python3."
18:30:02.60 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution5Fp4yj for "Test binary /Users/asher/.pyenv/versions/3.7.4/bin/python3."
18:30:02.60 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution4AkbH8 for "Test binary /Users/asher/.pyenv/versions/3.9.4/bin/python3."
18:30:02.60 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution5QD0xK for "Test binary /usr/local/bin/python3."
18:30:02.63 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionTnLdm2 for "Test binary /Users/asher/.pyenv/versions/3.8.12/bin/python."
18:30:02.63 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionIXK54D for "Test binary /Users/asher/.pyenv/versions/3.6.11/bin/python."
18:30:02.63 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionfkBsGV for "Test binary /Users/asher/.pyenv/versions/3.8.9/bin/python."
18:30:02.64 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution9QwFdw for "Test binary /usr/bin/python."
18:30:02.70 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionDtEa5p for "Test binary /Users/asher/.pyenv/versions/3.9.4/bin/python."
18:30:02.71 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution7vlJut for "Test binary /Users/asher/.pyenv/versions/2.7.14/bin/python."
18:30:02.72 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionuKXFTC for "Test binary /Users/asher/.pyenv/versions/3.7.4/bin/python."
18:30:02.73 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionZTVrEK for "Test binary /Users/asher/.pyenv/versions/2.7.14/bin/python2."
18:30:02.74 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution62LWro for "Test binary /usr/bin/python2."
18:30:02.83 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executiongRh2eI for "Find interpreter for constraints: CPython<3.9,>=3.8"
18:30:04.66 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution112b4U for "Run Black on 60 files."
18:30:09.01 [ERROR] Completed: Lint with Black - Black failed (exit code 1).
would reformat posthog/api/annotation.py
would reformat posthog/api/decide.py
would reformat posthog/api/__init__.py
would reformat posthog/api/paths.py
would reformat posthog/api/authentication.py
would reformat posthog/api/organization_invite.py
would reformat posthog/api/organization.py
would reformat posthog/api/sessions_filter.py
would reformat posthog/api/feature_flag.py
would reformat posthog/api/capture.py
would reformat posthog/api/session_recording.py
would reformat posthog/api/insight.py
would reformat posthog/api/dashboard.py
would reformat posthog/api/test/test_annotation.py
would reformat posthog/api/action.py
would reformat posthog/api/person.py
would reformat posthog/api/test/test_element.py
would reformat posthog/api/test/test_cohort.py
would reformat posthog/api/test/test_action.py
would reformat posthog/api/signup.py
would reformat posthog/api/test/test_event_definition.py
would reformat posthog/api/test/test_authentication.py
would reformat posthog/api/test/test_organization.py
would reformat posthog/api/test/test_organization_invites.py
would reformat posthog/api/test/test_personal_api_keys.py
would reformat posthog/api/test/test_organization_members.py
would reformat posthog/api/test/test_decide.py
would reformat posthog/api/test/test_dashboard.py
would reformat posthog/api/test/test_property_definition.py
would reformat posthog/api/test/test_retention.py
would reformat posthog/api/test/test_preflight.py
would reformat posthog/api/test/test_action_people.py
would reformat posthog/api/test/test_insight.py
would reformat posthog/api/test/test_feature_flag.py
would reformat posthog/api/test/test_team.py
would reformat posthog/api/test/test_person.py
would reformat posthog/api/test/test_capture.py
would reformat posthog/api/test/test_event.py
would reformat posthog/api/test/test_session_recordings.py
would reformat posthog/api/user.py
would reformat posthog/api/test/test_user.py
would reformat posthog/api/test/test_plugin.py
would reformat posthog/api/test/test_signup.py
Oh no! πŸ’₯ πŸ’” πŸ’₯
43 files would be reformatted, 17 files would be left unchanged.
``````
@witty-crayon-22786 any ideas here?
w
being in the repo root is different from being in the chroot for the process
p
I though I did.
w
…sorry. the output shows that you did. but you need to actually look inside the relevant chroot
p
how do I know what is the chroot of the process?
w
Copy code
18:30:04.66 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution112b4U for "Run Black on 60 files."
p
I am running everything from the repo root.
and see if pyproject.toml was copied there?
w
right
p
got it. looking.
w
all processes that pants runs run in sandboxes
p
seems so.
Copy code
➜  posthog-foss git:(pants-manual-for-toolchain) ./pants --no-process-execution-local-cleanup lint posthog/api/::
10:09:45.17 [INFO] Initializing scheduler...
10:09:45.31 [INFO] Scheduler initialized.
10:09:45.49 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionI2CeTG for "Searching for `bash` on PATH=/usr/bin:/bin:/usr/local/bin"
10:09:45.65 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executioncYE2L1 for "Test binary /bin/bash."
10:09:45.66 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionARS7GN for "Searching for `python` on PATH=/Users/asher/.pyenv/versions/2.7.14/bin:/Users/asher/.pyenv/versions/3.6.11/bin:/Users/asher/.pyenv/versions/3.7.4/bin:/Users/asher/.pyenv/versions/3.8.12/bin:/Users/asher/.pyenv/versions/3.8.9/bin:/Users/asher/.pyenv/versions/3.9.4/bin:/Users/asher/.nvm/versions/node/v16.11.1/bin:/Users/asher/.gem/ruby/2.6.0/bin/:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/Library/Apple/usr/bin:/Users/asher/.cargo/bin:/Users/asher/go/bin/:/Users/asher/.poetry/bin:/Users/asher/.krew/bin:/Users/asher/.local/bin"
10:09:45.66 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionj9ELWH for "Searching for `python3` on PATH=/Users/asher/.pyenv/versions/2.7.14/bin:/Users/asher/.pyenv/versions/3.6.11/bin:/Users/asher/.pyenv/versions/3.7.4/bin:/Users/asher/.pyenv/versions/3.8.12/bin:/Users/asher/.pyenv/versions/3.8.9/bin:/Users/asher/.pyenv/versions/3.9.4/bin:/Users/asher/.nvm/versions/node/v16.11.1/bin:/Users/asher/.gem/ruby/2.6.0/bin/:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/Library/Apple/usr/bin:/Users/asher/.cargo/bin:/Users/asher/go/bin/:/Users/asher/.poetry/bin:/Users/asher/.krew/bin:/Users/asher/.local/bin"
10:09:45.66 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executioncQ7neM for "Searching for `python2` on PATH=/Users/asher/.pyenv/versions/2.7.14/bin:/Users/asher/.pyenv/versions/3.6.11/bin:/Users/asher/.pyenv/versions/3.7.4/bin:/Users/asher/.pyenv/versions/3.8.12/bin:/Users/asher/.pyenv/versions/3.8.9/bin:/Users/asher/.pyenv/versions/3.9.4/bin:/Users/asher/.nvm/versions/node/v16.11.1/bin:/Users/asher/.gem/ruby/2.6.0/bin/:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/Library/Apple/usr/bin:/Users/asher/.cargo/bin:/Users/asher/go/bin/:/Users/asher/.poetry/bin:/Users/asher/.krew/bin:/Users/asher/.local/bin"
10:09:45.77 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionkknoDR for "Test binary /Users/asher/.pyenv/versions/3.8.9/bin/python."
10:09:45.78 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution6EOqhT for "Test binary /Users/asher/.pyenv/versions/3.8.12/bin/python."
10:09:45.78 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionCiJEg5 for "Test binary /Users/asher/.pyenv/versions/3.6.11/bin/python."
10:09:45.78 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution9M8nK7 for "Test binary /Users/asher/.pyenv/versions/2.7.14/bin/python."
10:09:45.78 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionfaxsuw for "Test binary /Users/asher/.pyenv/versions/3.9.4/bin/python."
10:09:45.78 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionP4PbrA for "Test binary /Users/asher/.pyenv/versions/3.7.4/bin/python."
10:09:45.78 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionwhEeaR for "Test binary /usr/bin/python."
10:09:45.83 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution4bmOPZ for "Test binary /Users/asher/.pyenv/versions/3.8.12/bin/python3."
10:09:45.83 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionV67TUL for "Test binary /Users/asher/.pyenv/versions/3.7.4/bin/python3."
10:09:45.83 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionP4KJxo for "Test binary /Users/asher/.pyenv/versions/3.6.11/bin/python3."
10:09:45.83 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionCtMtip for "Test binary /Users/asher/.pyenv/versions/3.8.9/bin/python3."
10:09:45.86 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionUnwSAW for "Test binary /Users/asher/.pyenv/versions/3.9.4/bin/python3."
10:09:45.88 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executions1AJuQ for "Test binary /usr/local/bin/python3."
10:09:45.91 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionmk4daf for "Test binary /usr/bin/python3."
10:09:45.92 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionsFDXEJ for "Test binary /usr/bin/python2."
10:09:45.93 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionXy7Cp0 for "Test binary /Users/asher/.pyenv/versions/2.7.14/bin/python2."
10:09:46.07 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-execution8IwGld for "Find interpreter for constraints: CPython<3.9,>=3.8"
10:09:47.89 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionegOvBZ for "Building black.pex from black_default_lockfile.txt"
10:09:51.39 [INFO] Completed: Building black.pex from black_default_lockfile.txt
10:09:51.40 [INFO] Preserving local process execution dir /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionsTGxKQ for "Run Black on 60 files."
10:09:56.05 [ERROR] Completed: Lint with Black - Black failed (exit code 1).
would reformat posthog/api/annotation.py
would reformat posthog/api/decide.py
would reformat posthog/api/__init__.py
would reformat posthog/api/authentication.py
would reformat posthog/api/paths.py
would reformat posthog/api/organization_invite.py
would reformat posthog/api/sessions_filter.py
would reformat posthog/api/organization.py
would reformat posthog/api/capture.py
would reformat posthog/api/feature_flag.py
would reformat posthog/api/session_recording.py
would reformat posthog/api/insight.py
would reformat posthog/api/dashboard.py
would reformat posthog/api/test/test_annotation.py
would reformat posthog/api/action.py
would reformat posthog/api/person.py
would reformat posthog/api/test/test_element.py
would reformat posthog/api/test/test_cohort.py
would reformat posthog/api/test/test_action.py
would reformat posthog/api/signup.py
would reformat posthog/api/test/test_event_definition.py
would reformat posthog/api/test/test_authentication.py
would reformat posthog/api/test/test_organization.py
would reformat posthog/api/test/test_organization_invites.py
would reformat posthog/api/test/test_personal_api_keys.py
would reformat posthog/api/test/test_organization_members.py
would reformat posthog/api/test/test_decide.py
would reformat posthog/api/test/test_property_definition.py
would reformat posthog/api/test/test_dashboard.py
would reformat posthog/api/test/test_retention.py
would reformat posthog/api/test/test_preflight.py
would reformat posthog/api/test/test_action_people.py
would reformat posthog/api/test/test_insight.py
would reformat posthog/api/test/test_feature_flag.py
would reformat posthog/api/test/test_team.py
would reformat posthog/api/test/test_person.py
would reformat posthog/api/test/test_event.py
would reformat posthog/api/test/test_session_recordings.py
would reformat posthog/api/test/test_capture.py
would reformat posthog/api/user.py
would reformat posthog/api/test/test_user.py
would reformat posthog/api/test/test_plugin.py
would reformat posthog/api/test/test_signup.py
Oh no! πŸ’₯ πŸ’” πŸ’₯
43 files would be reformatted, 17 files would be left unchanged.



𐄂 Black failed.
➜  posthog-foss git:(pants-manual-for-toolchain) βœ— ls /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionsTGxKQ/
__run.sh                     black.pex                    black.pex_bin_python_shim.sh black.pex_pex_shim.sh        posthog                      pyproject.toml
➜  posthog-foss git:(pants-manual-for-toolchain) βœ— cat /private/var/folders/hv/p6g7p3p95d19gtm5cfkrk5w00000gn/T/process-executionsTGxKQ/pyproject.toml
[tool.black]
line-length = 120

[tool.isort]
multi_line_output = 3
include_trailing_comma = true
force_grid_wrap = 8
ensure_newline_before_comments = true
line_length = 120%
➜  posthog-foss git:(pants-manual-for-toolchain) βœ—
w
so… i think that it probably is using their config? perhaps they use a different version
πŸ‘ 1
h
Oh good idea with the version being different
p
indeed, pants is using
black==21.8b0
and the one in the venv is 19
Copy code
➜  posthog-foss git:(pants-manual-for-toolchain) βœ— .venv/bin/black --version
black, version 19.10b0
➜  posthog-foss git:(pants-manual-for-toolchain) βœ—
let me try and upgrade that.
w
or down, yea
p
yes. that was it. thanks! I am still confused by it... but it is mostly on the black side (did they change formatting rules between versions? will check)
thanks for the help!
much appreciated!
πŸ‘ 2