The overall use case is that I'm trying to get a pex with numpy/scipy/sklearn together. I've been able to build wheels for these outside the context of pex.