<https://developer.ibm.com/blogs/case-study-increm...
# randomb
bitter-ability-32190
08/25/2022, 5:34 PMbitter-ability-32190
08/25/2022, 5:34 PMCC @busy-vase-39202
🔥 2
❤️ 3
b
busy-vase-39202
08/25/2022, 6:01 PMThread! https://twitter.com/pantsbuild/status/1562860861445660672?s=20&t=AqOyDwkuQhHjrRAHytwyLA Thank you @bitter-ability-32190 @high-yak-85899 and @happy-kitchen-89482 for the combined impactfulness of your writeups. ❤️
h
hundreds-father-404
08/25/2022, 6:03 PMnice! can we cross-post to Pants blog by chance? Or write a one-paragraph Pants blog that links to this?
b
bitter-ability-32190
08/25/2022, 6:07 PMThere's a typo
Lines of metadata: 20,000 2,4000has an extra 0 at the end 😛 Oh and I'm on twitter now: https://twitter.com/thejcannon
b
busy-vase-39202
08/25/2022, 6:09 PMThankfully the comma disambiguated the typo. Since twitter doesn't have an edit button, it'd be a pain to recreate the thread, images, and ALT text so I'm gonna leave it.
b
bitter-ability-32190
08/25/2022, 6:09 PMah RIP. But that makes sense tho as well
a
average-vr-56795
08/26/2022, 10:49 AMVery cool! I'm curious - what was the biggest part of the 6-8 minutes of savings?
average-vr-56795
08/26/2022, 10:50 AMAnd what was the difference between the two systems that meant docker images were easier to make more custom per target?
b
bitter-ability-32190
08/26/2022, 11:06 AMAdmittedly the prior art didn't cache the virtualenv needed to run formatters/linters between runs. That was a big chunk.
And running those tools took time and weren't themselves cached.
So we could've had some savings while sticking to Bazel, but I also wanted the big savings internally and externally as a "win".
bitter-ability-32190
08/26/2022, 12:09 PMBazel doesn't use docker to build images. It uses a library that allows it to make images itself, and registers them with docker.
It makes custom workflows really annoying, so devs piled everything in a base image.
There was also issues with caching that made a monolithic base image desirable
bitter-ability-32190
08/26/2022, 4:50 PM(a part of all this is our engineers are data scientists, so very much a "path of least resistance" nature)
😊 1
bitter-ability-32190
08/26/2022, 4:53 PMLastly, over specified dependencies hurts the cache granularity and we have some looooooong tests