fresh-architect-74417
02/27/2020, 3:59 PMhundreds-father-404
02/27/2020, 4:03 PMfresh-architect-74417
02/27/2020, 4:07 PMhundreds-father-404
02/27/2020, 4:12 PMYes, I know that pants can use a centralized cache. I have a centralized cache server for our CI server. It’s not really distributed.The V2 system is different and an entire re-architecture of how Pants does caching and parallelizes work (originally inspired by how Bazel does things). For example, when running tests with V2, you can use remote execution to have each test target run with its own worker. So if you have 100 tests and 100 workers, you can run all 100 tests concurrently. With V2's caching, if you rerun those 100 tests and only 2 actually changed, then you’d immediately get the results for 98 of the 100 tests. Locally, you can configure how many threads you want to allow to get the same effect.
Does pants support running multiple workers in a pool, then use that pool to run the unittests?Yes. To use this, you’d switch to using the V2 test runner (which Pants has been using for 5 months now and Toolchain has been using for 3 months), then possibly tweak
--process-execution-local-parallelism
if you don’t like the default
If you’re interested in trying it out, we would be eager to help get you set up with the V2 test runner! cc @happy-kitchen-89482fresh-architect-74417
02/27/2020, 4:35 PMprocess-execution-local-parallelism
Does that flag run only on a single machine?hundreds-father-404
02/27/2020, 4:35 PM--process-execution-remote-parallelism
to complement itfresh-architect-74417
02/27/2020, 4:46 PMprocess-execution-remote
?happy-kitchen-89482
02/27/2020, 6:25 PMfresh-architect-74417
02/27/2020, 6:46 PMhappy-kitchen-89482
02/27/2020, 7:05 PMfresh-architect-74417
02/27/2020, 7:20 PMhappy-kitchen-89482
02/27/2020, 8:09 PM