I’m getting the dreaded `Failed to digest inputs: ...
# general
s
I’m getting the dreaded
Failed to digest inputs: "Error storing Digest: Input/output error"
. My understanding is this comes from my Pex file being too large. Is there a good way to debug/understand how big the things going into it are? I assume that this is because I’m using a GPU version of PyTorch which is a massive
whl
w
where in your build are you seeing it?
s
When I try and pants package I get this at the end of the command output
w
got it. yea, for
pants package
in particular, the solution is generally to switch from using a monolithic
pex
file to using the
packed
layout: https://www.pantsbuild.org/docs/reference-pex_binary#codelayoutcode
a fix is coming for the large file issue in the 2.17.x series, but in many cases the
packed
layout is preferable anyway when your deploy binary gets this large.
s
Ah okay, yeah this does seem to work. Torch with CUDA is a shocking 3.5 GB on disk….
😅 2