Hi there 👋 I am trying to incorporate Pants in our CI to run tests. So far, we used pytest on the agents. A snippet of our repo is as below. I can successfully run the unit tests using

pants test

. However, when trying

pants test governance/app1/test/dataplatform/governance/app1/integration/

, I get

ModuleNotFoundError: No module named 'dataplatform.governance.app1.integration.fixtures

. I have seen many questions regarding

conftest.py

but could not really understand how to solve this issue? Any help is very appreciated 🙂

├── app1
│   ├── BUILD
│   ├── Dockerfile
│   ├── main
│   │   ├── BUILD
│   │   ├── app.py
│   │   └── dataplatform
│   │       └── governance
│   │           └── app1
│   │               ├── BUILD
│   │               ├── client.py
│   ├── test
│   │   ├── BUILD
│   │   ├── conftest.py
│   │   ├── dataplatform
│   │   │   └── governance
│   │   │       └── app1
│   │   │           ├── integration
│   │   │           │   ├── BUILD
│   │   │           │   ├── __init__.py
│   │   │           │   ├── fixtures
│   │   │           │   │   ├── BUILD
│   │   │           │   │   ├── __init__.py
│   │   │           │   │   └── client_fixtures.py
│   │   │           │   ├── test_integration_client.py
│   │   │           └── unit
│   │   │               ├── BUILD
│   │   │               ├── __init__.py
│   │   │               ├── test_client.py

app1/test/BUILD

->

python_test_utils(
    name="test_utils",
)

app1/test/conftest.py

->

pytest_plugins = [
    "dataplatform.governance.app1.integration.fixtures.client_fixtures",
]

pants.toml

->

[source]
root_patterns = [
    'main',
    'test'
]

My guess would be that

main/dataplatform

shadows the

test/dataplatform

PYTHONPATH. Try changing

test/dataplatform

to

test/dataplatform1

and see if that helps. Generally, you will need to play a bit with a directory layout of your tests as suggested here https://docs.pytest.org/en/7.1.x/explanation/goodpractices.html#choosing-a-test-layout-import-rules

Thanks @little-pilot-11155. That might be it. For now, after renaming to

test/dataplatform1

, it is still failing with

ImportError: Error importing plugin "dataplatform1.governance.app1.integration.fixtures.client_fixtures": No module named 'dataplatform1.governance.app1.integration'

I will have a look at the source you provided.

It’s possible also that you’d need to add an explicit dependency in the BUILD file from your test code to the fixtures folder. Ex:

python_test_utils(
    name="test_utils",
    dependencies=["app1/test/dataplatform/governance/app1/integration:target"]
)

After renaming to

test/dataplatform1

, I actually succeeded in running the integration tests by adding the dependency explicitly in

governance/app1/test/dataplatform1/governance/app1/integration/BUILD

python_tests(
    name="tests",
    dependencies=[
        "//3rdparty/python:reqs",
        "//3rdparty/python:reqs0",
"governance/app1/test/dataplatform1/governance/app1/integration/fixtures"
    ],
)

I will test out your suggestion @better-van-82973 🙏 I guess this would allow me to keep the naming as

test/dataplatform

?

Yeah, if you specify the dependency name explicitly then you should be able to call it whatever you’d like to

Thanks works like a charm. In case it can help someone in the future, second solution, without needing to rename the

test/dataplatform

directory, is via:

governance/app1/test/BUILD

python_test_utils(
    name="test_utils",
    dependencies=["governance/app1/test/dataplatform/governance/app1/integration:tests"]
)

Thanks again @little-pilot-11155 and @better-van-82973 ✌️

TIL 🙂