Aha. Thanks @bulky-library-34172. This is a pytest requirement (see bottom of page here: https://pytest.readthedocs.io/en/reorganize-docs/new-docs/user/directory_structure.html) but perhaps Pants should help validate this and fail fast with a more helpful message: https://github.com/pantsbuild/pants/issues/6281