Filed an issue: https://github.com/pantsbuild/pants/issues/2733 I am seeing that when I rearrange the dependencies in a BUILD file, it works, and is repeatable.