https://pantsbuild.org/ logo
Powered by
#pex
  • r

    rough-minister-58256

    01/18/2018, 11:47 PM
    but it might be lower in the execution than the bootstrapping
  • s

    stocky-greece-3497

    01/18/2018, 11:59 PM
    Yep, that's definitely what it was. We manually removed 
    dist-packages
    from 
    sys.path
    and we're good to go 👍
  • r

    rough-minister-58256

    01/19/2018, 12:00 AM
    wicked
  • s

    stocky-greece-3497

    01/19/2018, 12:00 AM
    Thanks a ton for the help! You definitely nudged us to the right spot 🙇 🙇
  • r

    rough-minister-58256

    01/19/2018, 12:00 AM
    np
  • f

    fast-nail-55400

    02/07/2018, 4:38 PM
    so I am trying to use 
    pkg_resources.resource_filename
    from within a pex but get this error:
    Copy code
    NotImplementedError: resource_filename() only supported for .egg, not .zip
  • f

    fast-nail-55400

    02/07/2018, 4:38 PM
    I can't use 
    resource_string
    or 
    resource_stream
    since I'm dealing with a legacy API that wants a filename
  • r

    rough-minister-58256

    02/07/2018, 4:52 PM
    I think thats because filenames aren’t externalized in a zip? you’d have to resource_stream them out to a temp path and pass that
  • s

    stocky-greece-3497

    02/07/2018, 5:26 PM
    @fast-nail-55400 long ago I ran into that and needed to extract a 
    .py
    file so it could be run via 
    subprocess
    , take a look at 
    from _pex.util import access_zipped_assets
    https://github.com/pantsbuild/pex/blob/master/pex/util.py#L46
  • r

    rough-minister-58256

    02/07/2018, 5:27 PM
    (or use zip_safe=False)
    🎯 1
  • f

    fast-nail-55400

    02/07/2018, 5:50 PM
    will take a look at those. thanks!
  • a

    average-vr-56795

    03/29/2018, 3:20 PM
    @enough-analyst-54434 @rough-minister-58256 Why does a pex file contain .pyc files for .bootstrap/_pex and .bootstrap/pkg_resources?
  • e

    enough-analyst-54434

    03/31/2018, 1:46 AM
    @average-vr-56795 I'm not sure. The general reasons for precompiling any python source at all were speed (https://github.com/pantsbuild/pex/issues/14) and a problem I'm not paging back in all that quickly here on my phone (https://github.com/pantsbuild/pex/issues/127 https://github.com/pantsbuild/pants/issues/1658).
  • r

    rough-minister-58256

    03/31/2018, 1:47 AM
    could also easily be an oversight/bug
  • e

    enough-analyst-54434

    03/31/2018, 1:51 AM
  • s

    stale-chef-81972

    04/03/2018, 5:40 PM
    do you have to do anything special to get pants to recognize wheel files of the format "pandas-0.22.0-cp27-cp27mu-manylinux1_x86_64.whl"? i have a wheelhouse dir registered in "python-repos" but it doesn't seem to recognize the pandas wheel i recently added
  • s

    stale-chef-81972

    04/03/2018, 5:41 PM
    i notice that wheels we built for linux in the past are all "-none-linux_x86_64.whl"
  • s

    stale-chef-81972

    04/03/2018, 7:00 PM
    went back a bit further in search history & found the relevant issue https://github.com/pantsbuild/pex/issues/281, looking into it now
  • s

    stale-chef-81972

    04/03/2018, 7:21 PM
    i just built some non-manylinux wheels using the _manylinux.py hack for reference
  • r

    rough-minister-58256

    04/03/2018, 7:24 PM
    manylinux wheels are just specialized linux-x86_64 wheels
  • r

    rough-minister-58256

    04/03/2018, 7:25 PM
    pex doesn’t currently support manylinux, largely because there’s no huge benefit to supporting it for most pro shops
  • r

    rough-minister-58256

    04/03/2018, 7:25 PM
    Copy code
    function rename_manylinux_wheels() {
  for manylinux_whl in $@; do
    local linux_whl=${manylinux_whl/manylinux1_x86_64/linux_x86_64}
    mv -f "${manylinux_whl}" "${linux_whl}"
  done
}
  • r

    rough-minister-58256

    04/03/2018, 7:25 PM
    applied to any manylinux wheel should ‘just work’
  • r

    rough-minister-58256

    04/03/2018, 7:26 PM
    I personally consider manylinux a bit of a gruesome hack
  • s

    stale-chef-81972

    04/03/2018, 8:19 PM
    nice thanks @rough-minister-58256
  • m

    magnificent-musician-12648

    04/04/2018, 1:48 PM
    there's always this PR: https://github.com/pantsbuild/pex/pull/316 🙂
    🎉 1
    s
    • 2
    • 1
  • m

    magnificent-musician-12648

    04/04/2018, 1:50 PM
    also, I would say there is a big benefit to supporting it in that many of us create out our manylinux wheels and would like to use them with pex
  • r

    rough-minister-58256

    04/04/2018, 4:39 PM
    yeah, we need to find some time to land one of those PRs for the greater community. just hasn’t been in the cards priority wise, since we aren’t dependent at all on manylinux - but are inundated with other project priorities.
  • m

    magnificent-musician-12648

    04/04/2018, 5:02 PM
    316 passes tests, has no merge conflicts, and I believe is even being used by some external organizations
  • r

    rough-minister-58256

    05/04/2018, 9:59 PM
    @magnificent-musician-12648 my team is carving out a few days of time for me to focus on the manylinux feature in pex. it doesn’t look like the additional changes, tests, etc from #399 ended up backmerged into #316 - but we’re going to need them to stabilize pex for pants. how would you like to proceed there?
1...464748...74Latest