Any way to make a python source target and all of its transi Pants #general

Join Slack

Any way to make a python source target and all of ...

# general

eager-dress-66405

12/02/2021, 2:10 PM

Any way to make a python source target and all of its transitive internal dependencies available to a docker image?

eager-dress-66405

12/02/2021, 2:12 PM

Context: I'm building an amazon sagemaker image. Need to have the script run in amazon's python env / library versions.

eager-dress-66405

12/02/2021, 2:14 PM

Currently depending on the pex and removing the deps. This works, but most of the build time is collecting and copying the 3rdparty deps.

Copy code

COPY src.infra.ml.sagemaker/train_cnv.pex /app
RUN unzip train_cnv.pex && rm -rf PEX-INFO train_cnv.pex __main__.py .deps .bootstrap

curved-television-6568

12/02/2021, 2:18 PM

Thank you for this question. This seems related to https://github.com/pantsbuild/pants/issues/13756 So, we could consider how to include any sources in the docker image, not only shell sources.

eager-dress-66405

12/02/2021, 2:24 PM

Ahh yes. I've also run into that issue and ended up defining a

shell_source

and

files

target for the same script so i could get linting and docker inclusion.

eager-dress-66405

12/02/2021, 2:26 PM

Related, it would be nice to make the

files

targets transitively depended on by a

docker_image

(via a

pex_binary

via a

python_library

) avaliable to the docker build context without needing to list them explicitly. https://pantsbuild.slack.com/archives/C046T6T9U/p1636515092094300

👍 1

👀 1

happy-kitchen-89482

12/02/2021, 4:52 PM

Sounds like the "thin pex" idea here might be what you want

➕ 1

6 Views

Open in Slack

Previous Next