are you doing rc or dev release? if rc, we need to cherry-pick https://github.com/pantsbuild/pants/pull/8877

but can cherry-pick that. cc @dry-policeman-7927

Thanks!