So I think the proper solution here is something we've talked about before, namely a

TargetSet

wrapper that knows about these operations and does the ugly work of finding a build graph instance if one is needed and also double checking that the user isn't doing something crazy like passing in targets into a set that live in two separate build graph instances