that isn't meant to be executed

Could you perhaps create a Pex but set

chmod -x

on it? Users could still say

python3.8 my_foo.pex

, but couldn't do

./my_foo.pex

It sounds like you do want third-party requireemnts included, right?