https://pantsbuild.org/ logo
#general
Title
# general
p

purple-motorcycle-67317

04/07/2023, 6:02 PM
Hi all! I'm trying to update my Poetry dependencies to include the
sagemaker
Python SDK, and some of the runs for a
pants check ::
(and other goals like package) are going on over 3 hours now, compared to if I remove that dependency it's 5 seconds. How can I best debug this and/or anyone have some ideas?
h

happy-kitchen-89482

04/07/2023, 7:46 PM
Ouch! What is it spending that 3 hours doing?
p

purple-motorcycle-67317

04/07/2023, 7:47 PM
I’m not quite sure 👀 Is there a verbosity flag I can use to inspect? Can’t seem to find one..
h

happy-kitchen-89482

04/07/2023, 7:49 PM
-ldebug
but is it not showing something in the "swimlanes" (the dynamic ui)?
p

purple-motorcycle-67317

04/07/2023, 7:53 PM
It just kind of continues at "Building requirements.pex with 25 requirements: StrEnum<0.5.0,>=0.4.8, StrEnum<" without changing
If I separate out sagemaker + boto3 dependencies into a separate package with its own pyproject.toml it builds for just that target. But if I try to
check ::
it continues its non-ending requirement building
r

refined-addition-53644

04/07/2023, 8:29 PM
Are you using any kind of lockfile? Are you pinning your boto3 version? If so does it align with what sagemaker requires? Sagemaker has dependency on boto3
p

purple-motorcycle-67317

04/07/2023, 8:43 PM
Yes, I'm using a poetry lockfile. Yes, to
^1.26.108
. And it aligns with what Sagemaker requires:
"boto3>=1.26.28,<2.0",
.
Also after separating out the packages, it seems like the check :: goal is the only thing that stalls. tests ::, lint ::, package ::, fmt :: all build fine
Ended up being that we had a version conflict with sagemaker and protobuf that never was detected between the two packages. had to downgrade protobuf to < 4.0.0. figured this out when you try to add sagemaker to the project that had protobuf, it would complain that there's no dependency solution, but that would not come up when you try to pants test/package/etc.
h

happy-kitchen-89482

05/26/2023, 4:44 AM
Thanks for the update
that'll be useful if anyone else hits a similar issue
2 Views