anyone else had issues using torch and transformers in a Pants project? All my dependencies work as expected, but for Torch I'm getting this error:

File "/home/delucca/.cache/pants/named_caches/pex_root/venvs/s/17fb5414/venv/lib/python3.11/site-packages/transformers/utils/import_utils.py", line 1495, in requires_backends
    raise ImportError("".join(failed))
                              └ ['\nAutoModelForTokenClassification requires the PyTorch library but it was not found in your environment. Checkout the instr...

ImportError:
AutoModelForTokenClassification requires the PyTorch library but it was not found in your environment. Checkout the instructions on the
installation page: <https://pytorch.org/get-started/locally/> and follow the ones that match your environment.
Please note that you may need to restart your runtime after installation.

(I've already generated lockfiles after I've added it to my

pyproject.toml

This is my `pyproject.toml`:

[project]
name = "item-matcher"
version = "0.1.0"
dependencies = [
    "fastapi>=0.11.0",
    "uvicorn>=0.30.1",
    "loguru>=0.7.2",
    "google-cloud-storage>=2.17.0",
    "google-auth>=2.31.0",
    "google-cloud-secret-manager>=2.20.1",
    "msgpack>=1.0.8",
    "dependency-injector>=4.41.0",
    "typing-extensions>=4.12.2",
    "transformers>=4.42.4",
    "numpy>=1.26.4",
    "torch>=2.0.0",
    "torchvision>=0.15.0",
    "torchaudio>=2.0.0"

]

[tool.pants]
pants_version = "2.21.0"

[tool.pants.backend.python]
interpreter_constraints = ["==3.11.*"]

[project.optional-dependencies]
dev = [
    "pytest>=8.2.2",
    "pytest-docker>=3.1.1",
    "httpx>=0.27.0",
]

I use dependency overrides, something like this in BUILD:

poetry_requirements(
    name="poetry",
    # pip is unable to infer these transitive dependencies
    overrides={
        "transformers": {"dependencies": [":poetry#torch"]},
    },
)

@steep-eve-20716 this is pretty clever! I'll test it, thanks

Yeah, when behavior is different depending on the presence or absence of an explicit

import

it usually means that Pants dep inference had no way to infer a dep (without that explicit

import

) so you need to add it manually

@happy-kitchen-89482 What metadata is missing in the direct dependency that prevents Pants/pex from identifying the transitive dep?

Presumably, since

transformers

works with or without

torch

(albeit with different behavior in each case), it does not require it?

HF has it as an optional dep in in

<https://github.com/huggingface/transformers/blob/main/setup.py>

bc yeah, transformers works without torch

Yeah, there is no sensible way to do that

yeah, makes sense

Yea totally makes sense

It would arguably be incorrect to infer a dep from transformers to torch

agreed

The semantics of transformers is - if you want torch, install it yourself

@steep-eve-20716 - lots of people have had various issues with torch as a dep in pants (and elsewhere); trying to sort out my own right now too

I guess the best pants could do is understand that if I have

transformers

and the

transformers[torch]

extra, automatically infer the relationship between the two instead of manually declaring it?

if I can, the only thing I would like to suggest is maybe adding a better explanation specifically about this in the docs. I can't point a suggestion of where to place it (because the site is down on my region) but it was really complicated for me (that doesn't have much Pants experience) to understand this detail

i saw someone mention adding a more cookbook / faq-style docs page; could be a really nice way of consolidating these sorts of notes somewhere a bit more loose

That would be great, since a lot of people have torch-related questions