Is there any way to activate the virtual environment a test

Question

Is there any way to activate the virtual environment a test is run in for that test execution I m dealing with a bunch of horrible things that Flink does that seem to only work if the python interpreter corresponds to one built with a virtual environment It s running commands from a jvm and bash script like `python m lt some things it expects to be on path gt ` When the test is executing `which python` just points to the system install at ` usr bin python`

enough-analyst-54434 · Answer

It looks like pytest is already run in a venv <https github com pantsbuild pants blob 3e62816f6e2bbe180962d855438ad6fcddb669fa src python pants backend python goals pytest runner py L281 L290|https github com pantsbuild pants blob 3e62816f6e2bbe180962d855438ad6fcddb669fa src python pants backend python goals pytest runner py L281 L290>

high-yak-85899 · Answer

Hmm when I do `subprocess check output which python ` it points back to system

enough-analyst-54434 · Answer

Well there are a few things getting mixed up here If you want `PATH` adjustment that s one thing Your example claimed `sys path` was the issue m

enough-analyst-54434 · Answer

IOW `sys executable m ` should work fine

high-yak-85899 · Answer

<https github com apache flink blob af681c63821c027bc7a233560f7765b686d0d244 flink python pyflink bin pyflink udf runner sh L43|Here> is the specific part that is unhappy And yeah I m trying to play some `PYTHONPATH` games to get things happy currently

enough-analyst-54434 · Answer

To get `PATH` adjustment this would need to be ` venv prepend` <https github com pantsbuild pants blob 3e62816f6e2bbe180962d855438ad6fcddb669fa src python pants backend python util rules pex py L888|https github com pantsbuild pants blob 3e62816f6e2bbe180962d855438ad6fcddb669fa src python pants backend python util rules pex py L888>

enough-analyst-54434 · Answer

So have you tried exporting `python=sys executable` The script you point to succumbs to that

enough-analyst-54434 · Answer

Just need to hook early enough Maybe conftest hook I have 0 clues about flink

high-yak-85899 · Answer

How do you mean export By environment variable or something else

enough-analyst-54434 · Answer

Yes env var Read the ~1st line of the script you pointed to

high-yak-85899 · Answer

Yeah mostly good things and then a few things like this that are so broken out of the box Unfortunately that env var setting didn t affect things and I m pretty sure it was high up enough

high-yak-85899 · Answer

It does work fine from the terminal so I must be doing something slightly wrong in test set up I ll keep poking Thanks for the ideas

enough-analyst-54434 · Answer

Ok and at the end of the day don t forget the ` venv prepend` thing I think that could be a safe global change to all Pants VenvPex setups so might be worth bugging amp fixing

enough-analyst-54434 · Answer

You could try it and run Pants from sources via your favorite technique to test

high-yak-85899 · Answer

I think I found a suitable workaround for now Setting `python` envvar didn t work but setting `PYTHONPATH` to where my source code and deps are did So basically copying what they do in <https github com apache flink blob af681c63821c027bc7a233560f7765b686d0d244 flink python pyflink bin pyflink udf runner sh L28>

happy-kitchen-89482 · Answer

Just checking that you re aware of ` keep sandboxes=always` which lets you play in the sandbox the test ran in