Hmmmm....

python_tests(
    name="tests",
    tags=["manual_test"],
)

./pants --tag='-manual_test' test path/to/tests/:

Seems to run the tests