Looking at a failure for `tests python pants test init test

Question

Looking at a failure for `tests python pants test init test plugin resolver py` due to symlinking big files ``` Kill the repo source dir and re resolve If the PluginResolver truly detects exact requirements it should skip any resolves and load directly from the still intact cache safe rmtree repo dir ``` Can someone help me understand what s going on here The issue is it the second go around I guess it s re resolving plugins which I suppose is a symptom of the bug and failing to find `jake`

bitter-ability-32190 · Answer

CI Fialure <https github com pantsbuild pants actions runs 4197189372 jobs 7279491564 step 11 499>

bitter-ability-32190 · Answer

Thinking out loud a bit here I m seeing `Resolving plugins ` twice in the log I m guessing that means the rule graph invalidated that mode All the inputs to that process should be 1 1 though

bitter-ability-32190 · Answer

Using `logging level=LogLevel DEBUG ` I can say for certain that both `Process`es are the same

bitter-ability-32190 · Answer

< witty crayon 22786> I know you re busy but I got a head scratcher

witty-crayon-22786 · Answer

sounds like it is failing to load from the cache the second time

witty-crayon-22786 · Answer

is there an error during the cache load perhaps

witty-crayon-22786 · Answer

if so it will be logged at debug <https github com pantsbuild pants blob 668e9b7d51096f9ec4a12700440bf03506844858 src rust engine process execution src cache rs L131 L140> because it is expected that things disappear from the cache due to GC

bitter-ability-32190 · Answer

out log

bitter-ability-32190 · Answer

I don t see that line

witty-crayon-22786 · Answer

i think you ll need to tease apart the cache lookup some more a bit more debug output in there confirm it actually did the lookup and with what key etc

witty-crayon-22786 · Answer

it s a bit of a silly test because it s effectively just testing process caching at this point it used to have a dedicated cache

witty-crayon-22786 · Answer

i assume that <https github com pantsbuild pants blob 668e9b7d51096f9ec4a12700440bf03506844858 src python pants engine process test py> is fully passing on the branch

bitter-ability-32190 · Answer

Oh hot take That could explain the timeouts too

bitter-ability-32190 · Answer

CI doesn t show it failing

witty-crayon-22786 · Answer

but yea i see the process running twice in your log and AFAIK that is not what should be happening there can compare with `main` to confirm but

bitter-ability-32190 · Answer

I think I have my breadcrumb The cache key isn t producing a hit There s probably more missing code in my local store impl

bitter-ability-32190 · Answer

At the very least I suspect we need to implement `get missing digests` `all digests` `remove` and the shrinking The first two might explain the failure

witty-crayon-22786 · Answer

Ah yea definitely `get missing digests` that s used in read write code paths The latter two are probably only used in GC

bitter-ability-32190 · Answer

And here I thought I hadn t used tokio fs enough triumph

bitter-ability-32190 · Answer

```14 26 11 87 INFO Completed Run Pytest tests python pants test init test plugin resolver py tests succeeded ``` Yup

bitter-ability-32190 · Answer

I really appreciate the assist heart