Hi there, I’m trying to use local wheels and I’m not sure if

pants

is actually getting the .whl files from the folder. What I have on my toml file is:

[python-repos]
repos.add = "%(buildroot)s/.wheels

One of the reasons I’m doing this is to try to speed up the test/bundle by not having to download any dependency from the internet (we have tensorflow and other ML libraries) and under our proxy things take forever 😞

I'm not sure what version this was added (1.27 maybe?) but you could try running this command on your target to see if pants is picking up your third party requirements

./pants dependencies --type=3rdparty helloworld/util

FWIW, we have a few wheels that are picked up from a directory and this is what our toml looks like:

[python-repos]
repos = [
    "%(buildroot)s/3rdparty/repos"
]

Hi! Also see the tooltip on https://www.pantsbuild.org/v2.0/docs/python-third-party-dependencies Turns out that we supported local wheels for a while via PEP 440, but didn’t realize it until last week

@important-librarian-62877 it is picking up the dependencies 🙂

nltk==3.4.5
numpy==1.19.1
python-json-logger==0.1.11
rasa==1.10.2
scipy==1.4.1
tensorflow==2.1.1
tensorflow-text==2.1.0rc0

and your approach on using

repos =

instead of

repos.add

made it faster.

Are you using the v2 engine or v1 engine? That feature only works with v2 unfortunately

Noooooo 😢

Hm cc @happy-kitchen-89482, do you have a chance to either look today, or point Thales or me in the right direction? Idk if you started taking a look yet.

When I try using the v2 it can’t even download the pex binary when it’s bootstraping. It doenst trust the source because of the self-signed cert that we have to use, that’s why we need to set up the

CURL_CA_BUNDLE

,

REQUESTS_CA_BUNDLE

and others to point to our cert.

The thing is that Rust doesnt seem to have any env variable to fix that so.. 😞

I was going to say that we can pass any arbitrary env var. But I’m not certain if Rust would recognize it. I haven’t checked. One thing that would help a lot is if you know of some way for us to simulate your proxy and test that this works. Of course, we can’t use your actual proxy, but I’m wondering if there’s some type of config we could use to simulate the environment.

I’ll see if I can find something to make this environment reproducible. So far I found this

mock-server

tool that might do it. I’ll try to set up that for you.

Thank you!