Would it be possible to have a `run` rule that req...
# plugins
m
Would it be possible to have a
run
rule that requests a
publish
before running a command? and if so, is there an example? Context in thread
We're using metaflow, and want to
publish
a docker image with all third-party deps before running a python_source command (which spins up jobs in k8s)
There are a couple other ways to solve this problem (like create a pex and execute remote from that), but publishing a docker image seems to be the best balance between correctness and speed (with large dependencies aka Tensorflow)
c
you should be able to use a special-cased dependencies field for listing the dependencies. Then, in your rule, you should be able to request the goal rule. The helm backend does something similar as part of the
experimental_deploy
goal, where it publishes docker containers as part of the deployment
👀 1