OK, adding

"-L", "native=/usr/local/opt/zlib/lib/"

to rustflags in

.cargo/config

fixed this