Well, it turns out it was not really working. The jars got uploaded to nexus and I was able to publish them, but the changes to

build-support/ivy/pushdb/org.pantsbuild/junit-runner-annotations/publish.properties

did not get made for all of the artifacts published. We have an artifact to depend on for now but the next publish may be broken.