#17162 Pants native code re-compiles without any good reason Issue created by sureshjoshi As per: https://pantsbuild.slack.com/archives/C0D7TNJHL/p1664222048965349 Created this ticket since this problem just happened again, after I had finished committing

pyright

code - only python code touched. I was able to get a filesystem modification log to see if any Rust code was obviously touched. Doesn't appear so (other than the fingerprint?). Logs, filesystem dump, and context below. * * * Slack context:

SJ: Is there any reason why native code is re-built every time I run a command? For a 5 minute code change, I'm on about 45 minutes of trying to commit it - between these compilation cycles, and pre-commit taking 10-15 minutes doing... something...

sj@tinyrick pants-completions % PY=python3.9 ./pants --changed-since=origin/main fmt lint
[=== 00:00 Building native code... ===]
Compiling pyo3-build-config v0.16.6
Compiling engine v0.0.1 (/Users/sj/Developer/oss/pants-completions/src/rust/engine)
Compiling pyo3-ffi v0.16.6
Compiling pyo3 v0.16.6
Building [=======================> ] 444/445: engine

Eric: We've been hacking on the engine much more the past month for the Docker feature, but it shouldn't be every time you run a command. Maybe every time you pull main if you don't do so frequently

SJ: Nope, cloned a new repo from main, created a branch, compiled, and then when doing linting/formatting, I got hit with I think 4-5 more compiles along the way - and I've only touched 3 python files

* * *

#  ./.pants.d/pants.log
22:07:45.50 [INFO] handling request: `--changed-since=cbaf0902195c8e3bd2d7897dff2398a1a4110e2a lint`
22:07:56.33 [INFO] request completed: `--changed-since=cbaf0902195c8e3bd2d7897dff2398a1a4110e2a lint`
22:07:57.28 [INFO] handling request: `run build-support/bin/check_inits.py`
22:08:00.44 [INFO] request completed: `run build-support/bin/check_inits.py`
22:08:01.38 [INFO] handling request: `run build-support/bin/check_banned_imports.py`
22:08:03.55 [INFO] request completed: `run build-support/bin/check_banned_imports.py`

-> SJ: Recompilation somewhere in this lease section below - when I next tried to run pyright <-

22:09:09.19 [INFO] Extending leases
22:09:09.32 [INFO] Done extending leases
22:10:29.34 [INFO] Extending leases
22:10:29.46 [INFO] Done extending leases
22:11:49.48 [INFO] Extending leases
22:11:49.58 [INFO] Done extending leases

``` # find . -type f -exec stat -f "%Sm %N" -t "%Y%y%m%d%H%M" {} \; | sort [... above these are all just compiled python files and then source files ...] 20222210072206 ./src/python/pants/util/__pycache__/meta.cpython-38.pyc 20222210072206 ./src/python/pants/util/__pycache__/ordered_set.cpython-38.pyc 20222210072206 ./src/python/pants/util/__pycache__/osutil.cpython-38.pyc 20222210072206 ./src/python/pants/util/__pycache__/resources.cpython-38.pyc 20222210072206 ./src/python/pants/util/__pycache__/strutil.cpython-38.pyc 20222210072206 ./src/python/pants/util/__pycache__/value_interpolation.cpython-38.pyc 20222210072206 ./src/python/pants/vcs/__pycache__/__init__.cpython-38.pyc 20222210072206 ./src/python/pants/vcs/__pycache__/changed.cpython-38.pyc 20222210072206 ./src/python/pants/vcs/__pycache__/git.cpython-38.pyc 20222210072206 ./src/rust/engine/target/release/.fingerprint/engine-129b40209128f1a7/lib-engine.json 20222210072206 ./src/rust/engine/target/release/deps/engine.engine.196cc17b-cgu.0.rcgu.o 20222210072206 ./src/rust/engine/target/release/deps/libengine.dylib 20222210072206 ./src/rust/engine/target/release/libengine.dylib 20222210072207 ./.pants.d/exceptions.63937.log 20222210072207 ./.pants.d/run-tracker/pants_run_2022_10_07_22_06_45_199_26386121f6db475399023fab2d4f04d8/logs 20222210072207 ./.pants.d/run-tracker/pants_run_2022_10_07_22_07_49_288_e8e931fced04489ea77a6812447ae924/logs 20222210072207 ./.pants.d/run-tracker/pants_run_2022_10_07_22_07_57_570_c5d91b33517d425d8aefd78712607146/logs 20222210072207 ./.pids/2ee2736cec13/pantsd/fingerprint 20222210072207 ./.pids/2ee2736cec13/pantsd/pid 20222210072207 ./.pids/2ee2736cec13/pantsd/process_name 20222210072207 ./.pids/2ee2736cec13/pantsd/socket 20222210072208 ./.git/COMMIT_EDITMSG 20222210072208 ./.git/logs/HEAD 20222210072208 ./.git/logs/refs/heads/17141-pyright 20222210072208 ./.git/objects/83/bf540adfaca888e0a25ead871ce315e17de154 20222210072208 ./.git/refs/heads/17141-pyright 20222210072208 ./.pants.d/run-tracker/pants_run_2022_10_07_22_08_01_658_d6eb3fe9980542928814c02966b291f9/logs 20222210072210 ./src/rust/engine/target/release/.fingerprint/engine-129b40209128f1a7/lib-engine 20222210072210 ./src/rust/engine/target/release/.fingerprint/engine-bfd629cc0604aa7b/run-build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/engine-bfd629cc0604aa7b/run-build-script-build-script-build.json 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-71697e9634a45b1b/run-build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-71697e9634a45b1b/run-build-script-build-script-build.json 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-b28cb431842f72f2/invoked.timestamp 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-b28cb431842f72f2/lib-pyo3 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-build-config-494844a142ad02e6/run-build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-build-config-494844a142ad02e6/run-build-script-build-script-build.json 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-build-config-b3ec6e3b36bed0f2/dep-lib-pyo3-build-config 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-build-config-b3ec6e3b36bed0f2/invoked.timestamp 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-build-config-b3ec6e3b36bed0f2/lib-pyo3-build-config 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-build-config-b3ec6e3b36bed0f2/lib-pyo3-build-config.json 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-f7e59450ab3ea08c/build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-f7e59450ab3ea08c/build-script-build-script-build.json 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-f7e59450ab3ea08c/dep-build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-f7e59450ab3ea08c/invoked.timestamp 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-a55b4f70a5b394b9/build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-a55b4f70a5b394b9/build-script-build-script-build.json 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-a55b4f70a5b394b9/dep-build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-a55b4f70a5b394b9/invoked.timestamp 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-ab77610b1a8d5439/run-build-script-build-script-build 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-ab77610b1a8d5439/run-build-script-build-script-build.json 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-e9ac07c84d5cc2b8/dep-lib-pyo3-ffi 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-e9ac07c84d5cc2b8/invoked.timestamp 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-e9ac07c84d5cc2b8/lib-pyo3-ffi 20222210072210 ./src/rust/engine/target/release/.fingerprint/pyo3-ffi-e9ac07c84d5cc2b8/lib-pyo3-ffi.json 20222210072210 ./src/rust/engine/target/release/build/engine-bfd629cc0604aa7b/invoked.timestamp 20222210072210 ./src/rust/engine/target/release/build/engine-bfd629cc0604aa7b/output 20222210072210 ./src/rust/engine/target/release/build/engine-bfd629cc0604aa7b/root-output 20222210072210 ./src/rust/engine/target/release/build/engine-bfd629cc0604aa7b/stderr 20222210072210… pantsbuild/pants

#17162 Pants native code re-compiles without any good reason Issue closed as completed by sureshjoshi pantsbuild/pants