But pytest.run has an option to turn that off, and run each test in isolation