Ah, it never does, pytest runs the test modules at the full paths specified in its input, not by reading them from the PYTHONPATH