wrote up some design for batching/parallelism improvements on https://github.com/pantsbuild/pants/issues/13462#issuecomment-1007752612 and https://github.com/pantsbuild/pants/issues/9964#issuecomment-1007775702: interested in any feedback!