Yes! it’s fine-grained “remote” caching of that content so a course-grained upload/download of the whole LMBD directory is no longer necessary.
Btw, I assume you’re aware of the GH limitation that may make the caching fail often: https://github.com/pantsbuild/pants/issues/20133
👍 1
p
proud-dentist-22844
05/18/2024, 3:59 AM
Yup. I see those failures in my test runs. stats shows a bunch of remote writes with a few failures. Then the next time it runs, there are a bunch of successful reads and some more writes. So over time they will all end up getting cached I suspect.
👍 1
proud-dentist-22844
05/18/2024, 4:01 AM
I wonder if the latency from all the tiny requests might end up taking more time than saving/retrieving the whole lmdb store... I hope your request for a bulk cache API gets some attention.