Hey folks, I'm probably doing amending silly, but I keep getting "no module named ..." for modules that need remapping. For example, azure-identity provides azure.identity, so I have in module_mapping

"azure-identity": ["azure.identity"]

. The dependency on that package shows up in

./pants dependencies ...

, And the package shows up in the message about which packages it's putting in the pex, and the whl for that package shows up in the pex sandbox. This doesn't seem to be a problem for tests, though, as they run just fine. I'm pretty sure it has something to do with resolves, as some of them work with

./pants run

and others don't. Short of binary-searching my dependencies, is there anything I can do to debug what's going on?

@careful-address-89803 Pex has several options to control how venvs are created and I expect

azure-nspkg

is one of the rare packages that is titchy wrt to how the venvs it lives in are constructed. Do you use https://www.pantsbuild.org/docs/reference-pex#venv_use_symlinks ? FWICT Pants itself uses the symlink mode for

./pants run

with no way for you to currently override this.

we aren't using that setting, but

./pants --pex-venv-use-symlinks test ::

causes the tests to fail in the same way.

Aha, ok. Thanks for testing that. So the explanation for the issue does appear to be that this is a library / set of libraries that do not, in fact, handle site-packages directories that use symlinks. It sounds like Pants needs plumbing for this toggle in more places or in 1 place that applies to more places.

makes sense. Do you want me to open an issue to track that?

That would be great. I can fill in code pointer details where we miss / hardcode this later today.

To follow up, I think this was a known issue / is fixed in 2.15.0.dev3 and forward, that is if your problem targets are

pex_binary

targets with

execution_mode="venv"

set. In the course of that investigation I found this:

PS C:\Users\John Sirois\Downloads> zipinfo azure_nspkg-2.0.0-py2.py3-none-any.whl | grep __init__
-rw-rw-rw-  2.0 fat        3 b- defN 17-Apr-10 19:06 azure/__init__.py
PS C:\Users\John Sirois\Downloads> unzip -qc azure_nspkg-2.0.0-py2.py3-none-any.whl azure/__init__.py | hexdump -C
00000000  e2 88 a9 e2 95 97 e2 94  90 0d 0a                 |...........|
0000000b

So the

azure_nspkg

__init__.py

is not empty! I guess it works but I have no clue what those bytes are except for the ending

\r\n

Windows end of line bytes.

Haha yeah, we're trying to get off of that train. The ansible collection

azuru.azcollection

is the last thing holding us up on that, they haven't really been updating it. Everything seems to work fine by removing the namespace package from my requirements.