Aha - I understand more now, http://jenkins.pantsbuild.org/job/test.pants.multibranch.pipeline/branch/PR-3283 (new job created per PR, makes more sense. I thought you sadistically named the 1 job after your branch