I thought even the chroot could be cached, to speed up subsequent builds (like it does with your local .pants.d) but that does not seem to be the case. Can someone confirm that this (only caching binaries) is how it should work?