I'm writing a python "pipeline" script that stitch...
# general
g
I'm writing a python "pipeline" script that stitches together several other python scripts. What's the correct way to do that in pants? (I've tried to call
./pants run
with python
subprocess
, but it doesn't allow me to do that since a pants process is already running. I've also tried to
subprocess.run
python (
sys.executable
) my scripts but it looks like that doesn't pick up the dependencies correctly (fail to import third party packages))
1
w
I’ve tried to call
./pants run
with python
subprocess
, but it doesn’t allow me to do that since a pants process is already running.
doing this with the
--concurrent
flag either to the subprocess, or to the parent
pants
process which is running the workflow would be the recommended approach currently. eventually when we support multiple concurrent requests to
pantsd
that flag will no longer be necessary, and we’ll deprecate it.
g
That seems to work. Thanks!