This all depends a lot on how hermetic you want your CI builds to be though. With perfect hermeticity you lose a lot of performance, and also sometimes you'd rather have the cache on in some CIs so you can identify cache issues/inconsistencies in a controlled environment