But wouldn't that mean you have to download a larger file, with all the dependecies?

Indeed. Although, with the normal

./pants

script, pip will still have to download those deps either way (unless already cached)