Thanks all! Yeah... I tried adding a setuptools dep and got no joy, I guess because we're side-stepping pex... But any pointers (or PRs ;)) to fixing it would be appreciated!

If you could try out https://github.com/pantsbuild/pants/pull/5976 locally, I'd be grateful. I've got no simple way to repro your interpreter cache.