Not sure of the best way to do this... I use airflow via Cloud Composer. In order to deploy the Directed Acyclic Graphs (DAGs), you zip up all of the python files containing those definitions. So there's no entrypoint or anything, just a zip of files. What I would like to do is also depend on our common library, so that some of the dags can use code from there. It doesn't look like I can just make an archive with "dependencies" on the dags' python library and have it transitively pull in my common library's code.

python_distribution

looks like it might be a way forward, but it looks like I'd have to make a separate distribution for the common library? It's relatively large, so I was hoping not to pull in the entire codebase. Is there a way I can make a zip of a current

python_library

that also pulls in all of its transitive dependency code?

Hmm

(relatedly: https://pantsbuild.slack.com/archives/C01CQHVDMMW/p1631733956057900)

We're just using terraform today to zip the directory since it's entirely self-contained now. We have to copy code we want to use into it.

I see, so the goal here would be to not have to copy the code?

Yep! Would be great to use dependency inference just like our cloud functions and pex binaries.

I see, so possibly a regular pex (which is just a zip file with the .pex suffix) would work?

Boom! That worked perfectly. Would have never thought of the fake entrypoint. Thanks!

Ah great!

Pants' pex_binary docs say you can set the entrypoint argument to "", but when I do I get an "InvalidFieldException" saying that I have to set it to some value.

I think you can just omit that field entirely?

Oh! I was reading the 2.6 docs when I was using 2.8. Yep, that totally works and jives with the docs that I should have been reading. Thanks for your patience!