Hi! I have Pants running in my CI pipeline for a ...
# general
h
Hi! I have Pants running in my CI pipeline for a long time now and in a repo which is quite big. I'm at a point now where I want to be able to instrument Pants with telemetry (traces) to find inefficiencies like dependency bottlenecks / hot-spots and slow steps so I could optimize the pipeline. Is there a way to do it today natively, with a plug-in, or by parsing Pants' logs/dump? If not, does it seam feasible for me to work on such a plugin / upstream patch? (any pointers?) Thanks! πŸ™‚
🧡
h
Toolchain (RIP) had this feature, and that repo is now open-sourced: https://github.com/toolchainlabs/toolchain-oss
I don’t think you could use that out of the box without running a whole lot of server stuff, but you could reuse parts of that code, or at least derive inspiration from it, with an eye to upstreaming it into the pants repo
@fast-nail-55400 and @witty-crayon-22786 know more about the details, I think
What were you thinking of for visualizing the traces?
I believe we had a semi-manual way to dump traces out of Pants and load them into the zipkin UI, for example, but my memory is hazy
h
I'm thinking about something like Grafana Traces or Honeycomb using OpenTelemetry.
And thanks, I'll take a look πŸ™‚ (sad though that Toolchain didn't πŸš€)
h
Coo, so FWIW the necessary data can be exposed via plugin (and the Toolchain plugin captured it), so hopefully that will be a good starting point
Feel free to copy/change/modify that code with an eye to upstreaming it
f
I recently wrote an OpenTelemtry plugin for Pants.
h
Thanks, @happy-kitchen-89482! @fast-nail-55400, are you teasing me he? XD Can you please share more details? πŸ™ƒ (or in a PM if you are waiting with a great reveal?)