in the pantsbuild/pants repo, we have things tagged with

tags={'integration'}

, so you can "run all of the integration tests in a directory" with

./pants --tag=integration test some/directory::