In general the best way to get around this (I find) is to invoke pip by saying

/path/to/venv/python -m pip <whatever>