Oh! After staring at a diagram of dependencies that I made (manually some time ago, before I found pants), I think I see how I can reverse how I was thinking about things.
The current grep-based lint does: This module should not import any of these other modules.
Visibility would say: This module is
which implicitly prevents the other module from importing it.