That is by design. The canonical way to truly nuclearly wipe all caching is to bump the cache key in

pants.ini