dazzling-diamond-4749
11/19/2021, 5:51 PMhundreds-father-404
11/19/2021, 5:52 PMdazzling-diamond-4749
11/19/2021, 5:53 PMdazzling-diamond-4749
11/19/2021, 5:53 PMhundreds-father-404
11/19/2021, 5:59 PMbuildroot()
?
Mind sharing the motivation?dazzling-diamond-4749
11/19/2021, 6:05 PMspark_job(
name="job",
source="entrypoint.py",
pex_name="path.to.src.python.my.job.pex",
cluster_config={...},
...
)
Currently I need to specify the pex_name because other wise the job submit system won't know where to find the PEX.
With a buildroot()
, I can easily generate the pex_name
in my macrodazzling-diamond-4749
11/19/2021, 6:08 PMbuildroot()
is just a mean to it.