The way I was able to easily diagnose it in the end is that I have a custom plugin that shows all the resolved jars for a binary (writes a file to META-INF/jar-manifest.txt) and then just diff the output between the two files.