Howdy 👋 . Looking for quick eyes on something. I've been running into a strange issue somewhere at the intersection of pants, pex, and wheels. When I take a dependency on the

PyMuPDF

python package, my app fails to start with a dynamic linking issue:

ImportError: dlopen(/Users/jake/.pex/venvs/721947db45864b75a0373c21d4d1aabf0829cb39/779eb2cc0ca9e2fdd204774cbc41848e4e7c5055/lib/python3.11/site-packages/fitz/_extra.cpython-311-darwin.so, 0x0002): Library not loaded: @rpath/libmupdf.dylib

I’ve run into this recently as well on our work repo, and from what I can tell it breaks for specific versions of

PyMuPDF

. We upgraded from version

1.24.0

to version

1.24.1

and we got a pretty similar error.

ah, interesting

I’m trying to see if that will work with your example repo. 1.24.0 has worked well for us at work though

I just tried

1.24.0

in my repro repo and it still fails 😕

I am definitely able to repro your issue in the example repo though:

ImportError: dlopen(/Users/krishnanchandra/.pex/installed_wheels/1cb99ef55a331a5f91f1ed691a232e14fe4ef5ca2334af00100be6baf35da287/PyMuPDF-1.23.26-cp311-none-macosx_11_0_arm64.whl/fitz/_extra.cpython-311-darwin.so, 0x0002): Library not loaded: @rpath/libmupdf.dylib
  Referenced from: <948BC1FA-DF38-3CE5-BAD2-8A12FE55521E> /Users/krishnanchandra/.pex/installed_wheels/1cb99ef55a331a5f91f1ed691a232e14fe4ef5ca2334af00100be6baf35da287/PyMuPDF-1.23.26-cp311-none-macosx_11_0_arm64.whl/fitz/_extra.cpython-311-darwin.so

I don't know much about how wheels work (new to python) so I'm having trouble determining if this is a

PyMuPDF

issue, a pants issue or a pex issue

Haven’t figured it out yet but it seems like there is some historical precedent for the issue: https://github.com/lucasrla/remarks/issues/7

There is also this nix issue that seems suspiciously familiar (nix having to make special accommodations for this package)

Here’s a good clue towards the solution in the time I’ve spent so far - normally, in the broken installations of PyMuPDF, the installed wheel looks something like this:

ls /Users/krishnanchandra/.pex/installed_wheels/71efe8cb3e0be4a9761976b9d0fd9cdc19abd44d490dcdf572858356e7157cde/PyMuPDF-1.23.11-cp312-none-macosx_11_0_arm64.whl/fitz/

__init__.py                  __pycache__                  _mupdf.so                    fitz.py                      table.py
__main__.py                  _extra.cpython-312-darwin.so extra.py                     mupdf.py                     utils.py

aaaaha - so it's possible that their macos arm64 cpython wheel is broken

Yeah, my environment also uses Python 3.12 while yours uses 3.11

I'm testing with python 3.12.1, one sec

It’s because that package is for

PyMuPDFb

(Note the lower case b at the end). That’s the binary package that PyMuPDF depends on, and where the dynamic library file comes from: https://pypi.org/project/PyMuPDFb/1.24.0/#files It seems like the issue here is that PyMuPDFb is not being installed when it should be. One thing you could try is adding

PyMuPDFb==1.24.0

as well to the

requirements.txt

file and seeing if that changes things.

oof, that's subtle.

Np! I’ve run into quite a few issues with PyMuPDF in the past so not surprised that it’s come up again…really surprising that I can’t repro the issue on my work repo, but that’s maybe for the best 😅

Created an issue to track: https://github.com/pantsbuild/pants/issues/20748

I've updated on that issue