You're right that pants setup can't be cached, for bootstrapping reasons, but what is cached over REAPI is the contents of the local_store_dir.