https://pantsbuild.org/ logo
s

straight-action-80318

03/28/2023, 9:51 PM
I’m getting the dreaded
Failed to digest inputs: "Error storing Digest: Input/output error"
. My understanding is this comes from my Pex file being too large. Is there a good way to debug/understand how big the things going into it are? I assume that this is because I’m using a GPU version of PyTorch which is a massive
whl
w

witty-crayon-22786

03/28/2023, 9:52 PM
where in your build are you seeing it?
s

straight-action-80318

03/28/2023, 10:01 PM
When I try and pants package I get this at the end of the command output
w

witty-crayon-22786

03/28/2023, 10:02 PM
got it. yea, for
pants package
in particular, the solution is generally to switch from using a monolithic
pex
file to using the
packed
layout: https://www.pantsbuild.org/docs/reference-pex_binary#codelayoutcode
a fix is coming for the large file issue in the 2.17.x series, but in many cases the
packed
layout is preferable anyway when your deploy binary gets this large.
s

straight-action-80318

03/28/2023, 11:53 PM
Ah okay, yeah this does seem to work. Torch with CUDA is a shocking 3.5 GB on disk….
😅 2