https://pantsbuild.org/ logo
#general
Title
# general
r

ripe-cpu-85141

11/21/2022, 4:53 PM
Hello. I'm using the publish goal to push Docker images to ECR. I noticed that pants push them sequentially, one by one. Is it something that can be parallelized or it's a limitation on Docker side?
c

curved-television-6568

11/21/2022, 4:57 PM
It’s perhaps a limitation in the combination of the two. Pants runs publish commands as interactive, i.e. as a forground process and as such is limited to one at a time. Docker in turn only allows to push a single image per invocation. Pls correct me if I’m wrong in this (regarding Docker push), as I do think that I did push multiple images at once at some point.. but maybe they removed that feature?
h

happy-kitchen-89482

11/21/2022, 5:02 PM
It’s a foreground process because only those are allowed to side-effect, but this is an interesting use-case
r

ripe-cpu-85141

11/21/2022, 5:05 PM
What kind of side effects are we talking about? As a comparison, the
package
target builds the images in parallel.
h

happy-kitchen-89482

11/21/2022, 7:22 PM
publishing is the ultimate side-effect… it changes state on a server! But I think this is a legitimate use-case for a side-effecting rule that can run concurrently. I think we can model this with an uncacheable regular rule instead of an interactive process though
r

ripe-cpu-85141

11/22/2022, 2:16 AM
I see. I'm not sure I follow but that's fine 🙂 Should I create a GH issue for my use case?
h

happy-kitchen-89482

11/22/2022, 4:25 AM
That would be great, thanks!
r

ripe-cpu-85141

11/22/2022, 2:16 PM
5 Views