I m getting the dreaded `Failed to digest inputs Error stori

Question

I m getting the dreaded `Failed to digest inputs Error storing Digest Input output error ` My understanding is this comes from my Pex file being too large Is there a good way to debug understand how big the things going into it are I assume that this is because I m using a GPU version of PyTorch which is a massive `whl`

witty-crayon-22786 · Answer

where in your build are you seeing it

straight-action-80318 · Answer

When I try and pants package I get this at the end of the command output

witty-crayon-22786 · Answer

got it yea for `pants package` in particular the solution is generally to switch from using a monolithic `pex` file to using the `packed` layout <https www pantsbuild org docs reference pex binary codelayoutcode>

witty-crayon-22786 · Answer

a fix is coming for the large file issue in the 2 17 x series but in many cases the `packed` layout is preferable anyway when your deploy binary gets this large

straight-action-80318 · Answer

Ah okay yeah this does seem to work Torch with CUDA is a shocking 3 5 GB on disk