from some offline discussion: one thing we think should probably happen before landing https://github.com/pantsbuild/pants/pull/5815 is something like https://github.com/pantsbuild/pants/issues/5920