does `pants lint ::` run in parallel?
# generalp
purple-plastic-57801
06/26/2023, 11:07 PMdoes
pants lint ::purple-plastic-57801
06/26/2023, 11:10 PMIt ends up being slower than pylint is why I'm asking.
b
bitter-ability-32190
06/27/2023, 10:58 AMYes. It runs batches of files in parallel (if not cached).
Likely pylint is using some cache that Pants can't use (for correctness)
p
purple-plastic-57801
06/27/2023, 4:57 PMCan we change the batch size?
Basically if I have a batch of 100 and one file in the 100 changes.. does that invalidate that batch? Odd question.. I don't think that is the case, but that is what a engineer believes.
b
bitter-ability-32190
06/27/2023, 4:58 PMYup it does. Batching is the middle-ground solution between "run one pylint process per file, likely saturating the CPU for a long time" and "run pylint with all files in it" essentially making the cache pointless 🙂
p
purple-plastic-57801
06/27/2023, 5:03 PMIt seems that the problem is that the engineer is using the pre-commit workflow where in the past pre-commit would pass the list of files that changed. --changed-since=(branch) seems to not be as fast.
b
bitter-ability-32190
06/27/2023, 5:05 PMUsing
--changed-sincebitter-ability-32190
06/27/2023, 5:05 PMThere's a floating idea I'll probably tackle in the coming months of opting into a different cache of "synthetic" results per-file. So you run on one big batch but pretend you did it per-file.
p
purple-plastic-57801
06/27/2023, 5:07 PMInteresting.
purple-plastic-57801
06/27/2023, 5:08 PMPerhaps it would be quickest to somehow make
pants run pylintpurple-plastic-57801
06/27/2023, 5:10 PMGranted
.build/requirements:pylint#pylintpurple-plastic-57801
06/27/2023, 5:10 PMpants export perhaps
b
bitter-ability-32190
06/27/2023, 5:12 PMOutside of
--keep-sandboxes=always3 Views