I just got another feature idea, unless you have a better answer to this problem.
Not that rarely, a newly added file is not checked into version control. This is tricky, since everything will keep working fine locally, so it will not be discovered (automatically) until you push.
I suggest an option to auto-ignore (source) files not under version control. This way, the file would not be picked up by pants, and the issue would surface much sooner.