A major downside Stu has pointed out though is that the output of things like

./pants test

would be less useful and less copy-and-pasteable. We would report that

dir#tests.py

succeeded, rather than

dir/tests.py