Does Pants have any native support for parallelizi...
# general
f
Does Pants have any native support for parallelizing tests across machines or Github Action workflows/jobs? There are too many tests in our monorepo to run sequentially (especially for pull requests that touch the common shared libraries). I'm wondering if we can even use the
pants test
goal for this or if we have to build our own parallelization logic based on the outputs from
pants dependencies
...
e
I haven't used it myself, but the
test
goal has an option for sharding your tests: https://www.pantsbuild.org/stable/reference/goals/test#shard
f
Oh, nice, thanks!
h
Yes, so one cheap-and-easy way to do this in CI is to shard the tests and run all shards concurrently on multiple workers. Pants’s own CI does this.
A more fine-grained and sophisticated approach is to use pants’s support for the Remote Execution API. You’d need to set up and maintain a remote execution cluster, or use a SaaS-provided one.
But that is a lot more work