pantsbuild #pex

pex.executor.Executor.ExecutionError: PermissionError(13, 'Permission denied') while trying to execute `/private/var/folders/3t/xkwqrkld4xxgklk2s4n41jb80000gn/T/tmpkux_60jg/tmp`

rough-minister-58256

07/19/2016, 12:12 AM

if someone wants to give me a shipit/lgtm on that, will land and cut a new 1.1.14 release with this and a couple other PRs that came in today

faint-holiday-3863

07/19/2016, 6:48 AM

apparently if you’re running from inside a pex, sys.executable is

””

rough-minister-58256

07/19/2016, 6:49 AM

eh?

rough-minister-58256

07/19/2016, 6:49 AM

Copy code

[illuminati ~]$ pex requests -o /tmp/throwaway.pex
[illuminati ~]$ /tmp/throwaway.pex
Python 2.7.10 (default, Dec 16 2015, 14:09:45) 
[GCC 4.2.1 Compatible Apple LLVM 7.0.2 (clang-700.1.81)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
(InteractiveConsole)
>>> import sys
>>> sys.executable
'/opt/twitter_mde/package/python2.7/current/bin/python'
>>>

faint-holiday-3863

07/19/2016, 6:50 AM

I just stuck a

print “CURRENT PYTHON: %s” % sys.executable

in the main module of a pex and got:

faint-holiday-3863

07/19/2016, 6:51 AM

CURRENT PYTHON:

rough-minister-58256

07/19/2016, 6:51 AM

the docs say:

Copy code

sys.executable
A string giving the absolute path of the executable binary for the Python interpreter, on systems where this makes sense. If Python is unable to retrieve the real path to its executable, sys.executable will be an empty string or None.

faint-holiday-3863

07/19/2016, 6:51 AM

yeah; just found that

rough-minister-58256

07/19/2016, 6:51 AM

maybe environmental?

faint-holiday-3863

07/19/2016, 6:51 AM

entirely possible; this is running inside the bazel execution sandbox

rough-minister-58256

07/19/2016, 6:51 AM

we depend on that quite a bit, so I’d be surprised

rough-minister-58256

07/19/2016, 6:51 AM

faint-holiday-3863

07/19/2016, 6:52 AM

yeahhhhhhh

faint-holiday-3863

07/19/2016, 6:52 AM

Copy code

<e55476a949b9dc1d4a94e1b8/execroot/bazel_rules_pex$ python
Python 2.7.6 (default, Jun 22 2015, 17:58:13)
[GCC 4.8.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.executable
‘’

rough-minister-58256

07/19/2016, 6:52 AM

heh nice

faint-holiday-3863

07/19/2016, 6:52 AM

(from a shell inside that sandbox)

faint-holiday-3863

07/19/2016, 6:53 AM

python is /usr/bin/python, which is a symlink to /usr/bin/python2.7, which appears to be a regular executable file

faint-holiday-3863

07/19/2016, 6:54 AM

oh ho, if I run python by its absolute path, sys.executable gets populated

faint-holiday-3863

07/19/2016, 7:02 AM

yeah this is weird and confusing and I should go to sleep

faint-holiday-3863

07/19/2016, 7:18 AM

actually it was just freaking out because there was no PATH variable set.

faint-holiday-3863

07/19/2016, 7:18 AM

facepalm

faint-holiday-3863

07/19/2016, 7:43 AM

here’s a new one.

faint-holiday-3863

07/19/2016, 7:44 AM

Copy code

Traceback (most recent call last):
  File ".bootstrap/_pex/pex.py", line 328, in execute
  File ".bootstrap/_pex/pex.py", line 260, in _wrap_coverage
  File ".bootstrap/_pex/pex.py", line 292, in _wrap_profiling
  File ".bootstrap/_pex/pex.py", line 371, in _execute
  File ".bootstrap/_pex/pex.py", line 429, in execute_entry
  File ".bootstrap/_pex/pex.py", line 434, in execute_module
  File "/usr/lib/python2.7/runpy.py", line 180, in run_module
    fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/var/tmp/benley-bazel-cache/_bazel_bstaffin/fe5f64f9e55476a949b9dc1d4a94e1b8/execroot/bazel_rules_pex/bazel-out/local-fastbuild/genfiles/pex/pex_wrapper.pex/.deps/pex_wrapper-0.0.0-py2.7.egg/pex_wrapper.py", line 140, in <module>
  File "/var/tmp/benley-bazel-cache/_bazel_bstaffin/fe5f64f9e55476a949b9dc1d4a94e1b8/execroot/bazel_rules_pex/bazel-out/local-fastbuild/genfiles/pex/pex_wrapper.pex/.deps/pex_wrapper-0.0.0-py2.7.egg/pex_wrapper.py", line 135, in main
  File "/nonexistent/.pex/install/pex-1.1.13-py2.py3-none-any.whl.54e2486bd5c6fda99021a6500098c4976315d6fc/pex-1.1.13-py2.py3-none-any.whl/pex/pex_builder.py", line 424, in build
    self.freeze(bytecode_compile=bytecode_compile)
  File "/nonexistent/.pex/install/pex-1.1.13-py2.py3-none-any.whl.54e2486bd5c6fda99021a6500098c4976315d6fc/pex-1.1.13-py2.py3-none-any.whl/pex/pex_builder.py", line 408, in freeze
    self._prepare_bootstrap()
  File "/nonexistent/.pex/install/pex-1.1.13-py2.py3-none-any.whl.54e2486bd5c6fda99021a6500098c4976315d6fc/pex-1.1.13-py2.py3-none-any.whl/pex/pex_builder.py", line 370, in _prepare_bootstrap
    for fn, content_stream in DistributionHelper.walk_data(setuptools):
  File "/nonexistent/.pex/install/pex-1.1.13-py2.py3-none-any.whl.54e2486bd5c6fda99021a6500098c4976315d6fc/pex-1.1.13-py2.py3-none-any.whl/pex/util.py", line 27, in walk_data
    for fn, stream in cls.walk_data(dist, full_fn):
  File "/nonexistent/.pex/install/pex-1.1.13-py2.py3-none-any.whl.54e2486bd5c6fda99021a6500098c4976315d6fc/pex-1.1.13-py2.py3-none-any.whl/pex/util.py", line 30, in walk_data
    yield full_fn[1:], dist.get_resource_stream(dist._provider, full_fn)
  File ".bootstrap/pkg_resources.py", line 1467, in get_resource_stream
IOError: [Errno 2] No such file or directory: u'/usr/lib/python3/dist-packages/DistUpgrade/NvidiaDetector’

faint-holiday-3863

07/19/2016, 7:45 AM

apparently ubuntu 14.04 ships with a broken symlink at /usr/lib/python3/dist-packages/DistUpgrade/NvidiaDetector and it seems to make pex unhappy

rough-minister-58256

07/19/2016, 7:47 AM

would file a bug

rough-minister-58256

07/19/2016, 7:47 AM

https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1485093

rough-minister-58256

07/19/2016, 7:47 AM

even mentions pex