What s the right way to provide C libraries to a pants proje

Question

What s the right way to provide C libraries to a pants project like if one of my python deps links against libcurl or something

enough-analyst-54434 · Answer

Does the linkage rely on `LD LIBRARY PATH` Pants tends towards hermetic by default and will not let arbitrary env vars leak into the processes it runs unless you poke holes If so I can point you at config for doing that

enough-analyst-54434 · Answer

That s here in case <https www pantsbuild org docs reference subprocess environment section env vars|https www pantsbuild org docs reference subprocess environment section env vars>

adventurous-island-11048 · Answer

Most likely yea there s a pycurl dependency in this code base Is the pants answer to pole holes and use the host s libcurl Or is there a reasonable way to build libcurl etc as well

enough-analyst-54434 · Answer

There is currently no support for building native libs unfortunately You can cheat via setup py Python but that s probably not going to work here

adventurous-island-11048 · Answer

Ah okay

adventurous-island-11048 · Answer

makes sense

enough-analyst-54434 · Answer

The cheat setup <https www pantsbuild org docs python distributions|https www pantsbuild org docs python distributions>

enough-analyst-54434 · Answer

We have people use that to get Cython support in Pants punt to setuptools

adventurous-island-11048 · Answer

makes sense once you get a PEP517 build backend involved you can do pretty much anything

enough-analyst-54434 · Answer

We d definitely love to support C C++ but man hours and all that so far

enough-analyst-54434 · Answer

Yeah exactly The build backend is the escape hatch

adventurous-island-11048 · Answer

yea no worries just messing around with different options for this code base figuring out what I m gonna propose pypi does to make our builds better

busy-vase-39202 · Answer

By the way if you re curious about Pants hermetic environment < ancient vegetable 10556> did a talk recently at Pycon about it and goes into the rationales behind some of its design

bitter-ability-32190 · Answer

We vendor our native libs alongside our compiled code and do it +compilation in a plugin man shrugging No ragrets

wide-midnight-78598 · Answer

gt We d definitely love to support C C++ but man hours and all that so far I have a draft PR for first party source compilation going in later this week but it ll be a while before it s even a remotely stable backend My target use case is C C++ libs bound to Python via pybind11 so it s a very Pants centric workflow once we have the C support

adventurous-island-11048 · Answer

Makes sense slightly smiling face I m half considering trying out writing a plugin that will just expose Nixpkgs

wide-midnight-78598 · Answer

Dooooo itttttttttt

bitter-ability-32190 · Answer

Pybind11 is header only right That s what we download and use setuptools in a plugin to provide a compiled C extension module

bitter-ability-32190 · Answer

Using http source see no evil Duct tape and string

wide-midnight-78598 · Answer

Love it However since I direly need a proper solution that isn t hacked together scripts cmake and whatever else for a project I m working on right now seems like the right time to do this

bitter-ability-32190 · Answer

Oh yes The more I can remove from my repos plugins the better chance my org has of staying afloat after my untimely demise at the sudden onset of a bus The chances will go from 0 to maybe 7 joy