Hello - I'm Shalabh and I work at Elementl on <Dag...
# welcome
a
Hello - I'm Shalabh and I work at Elementl on Dagster Cloud. We have just started using PEX to deploy user code for Dagster Cloud Serverless. We used to deploy Docker images but PEX gives us a reliable way to build and ship the same code much faster. I've been fairly impressed with PEX in my initial exploration. Once we get real user usage it will be interesting to see how it holds up.
👋 7
f
Welcome! Oh dagster is amazing, such a powerful toolset. Really excited seeing you exploring!
a
Thanks! We will briefly talk about our new code deploys in our upcoming community day: https://dagster.io/community-day
f
juicy!! Will you mention Pants??? ;)
👖 2
b
Good luck with your talk!
🙏 1
a
juicy!! Will you mention Pants??? 😉
🍿 not pants, but we mention pex. the livestream is tomorrow!
🙌 1
Hi folks, the stream is now live. Direct link to the relevant segment:

https://youtu.be/An78xLxM9zQ?t=1086

I also just tweeted about pex https://twitter.com/chatur_shalabh/status/1600564475303645184
🙌 2
b
Nice! This would make a good full-length conference talk, with opportunity to explore more of how Dagster, Docker, and PEX work together in practice. Have you considered proposing to Pycon US? The CFP is open through Friday. In my opinion, Pycon needs more CI/CD talks and this has potential to be a good one!
By the way, have you gotten to see these already? https://blog.pantsbuild.org/pants-pex-and-docker/ by @happy-kitchen-89482 and https://blog.pantsbuild.org/optimizing-python-docker-deploys-using-pants/ by @bitter-ability-32190 might also prove useful for you.
b
👋
My blog post is a Pants-ified version of this recipe from PEX, turned up to 11 🙂
a
Thanks - I only recently saw those blogs and they're great. For our code deploys, we don't even build the "final" Docker image. We have a base image that can pull a pex from s3 and run it. Note this is specifically for deploying user code. When the user updates some code, no new Docker image is built or provisioned. We can pull the new pex onto a warm container. When isolation is required, we can still launch a new container and point it to a single pex.
b
Ah, that's the timing difference you pointed out on the final slide. Got it.