Yeah, so that test has the fundamental problem that it runs on master where

pants_requirement()

- which it tests - resolves to a version that is mutable. IE: 1.5.0.devX mutates as we edit master and this defeats resolution caching assumptions that a fixed version is fixed.