Hey all I was wondering how to support building docker image Pants #general

Hey all, I was wondering how to support building d...

alert-dawn-51425

02/07/2023, 10:22 PM

Hey all, I was wondering how to support building docker images on a mac that can run in a linux docker image. Currently, It is failing to resolve the wheels. I will thread the runtime error and the pex_binary.

alert-dawn-51425

02/07/2023, 10:23 PM

Copy code

pex_binary(
    name="app",
    entry_point="main.py:main",
    layout="packed",
    execution_mode="venv",
    platforms=["linux-x86_64-cp-39-39"]
)

alert-dawn-51425

02/07/2023, 10:23 PM

Copy code

ProcessExecutionFailure: Process 'Building 35 requirements for klaviyo.domains.event_processing.ticketing_service.server/app.pex from the 3rdparty/python/python3-deps_lock.txt resolve: backoff==1.11.1, blinker==1.4, certifi==2022.6.15, charset-normalizer==2.1.0, click==8.0.1, deprecated==1.2.13, dumb-init==1.2.5, flask==2.0.1, googleapis-common-protos==1.56.1, grpcio==1.46.3, gunicorn==20.1.0, idna==3.2, itsdangerous==2.0.1, jinja2==3.0.1, markupsafe==2.0.1, opentelemetry-api==1.12.0, opentelemetry-exporter-otlp-proto-grpc==1.12.0, opentelemetry-exporter-otlp-proto-http==1.12.0, opentelemetry-exporter-otlp==1.12.0, opentelemetry-instrumentation-flask==0.33b0, opentelemetry-instrumentation-wsgi==0.33b0, opentelemetry-instrumentation==0.33b0, opentelemetry-proto==1.12.0, opentelemetry-sdk==1.12.0, opentelemetry-semantic-conventions==0.33b0, opentelemetry-util-http==0.33b0, protobuf==3.20.1, requests==2.28.1, sentry-sdk==0.12.3, six==1.16.0, statsd==3.3.0, typing-extensions==4.3.0, urllib3==1.26.6, werkzeug==2.0.1, wrapt==1.14.1' failed with exit code 1.
stdout:

stderr:
Failed to resolve compatible artifacts from lock 3rdparty/python/python3-deps_lock.txt for 1 target:
1. cp39-cp3939-linux_x86_64:
    Failed to resolve all requirements for abbreviated platform cp39-cp3939-linux_x86_64 from 3rdparty/python/python3-deps_lock.txt:

Configured with:
    build: False
    use_wheel: True

Dependency on blinker not satisfied, 1 incompatible candidate found:
1.) blinker 1.4 (via: blinker==1.4) does not have any compatible artifacts:
    <https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz>

Dependency on grpcio not satisfied, 1 incompatible candidate found:
1.) grpcio 1.46.3 does not have any compatible artifacts:
    <https://files.pythonhosted.org/packages/d8/b3/d960aa4379c300a6351ef572d62f7d0eb5d72e5941260008e86e306d6064/grpcio-1.46.3-cp39-cp39-musllinux_1_1_x86_64.whl>
    <https://files.pythonhosted.org/packages/0b/21/b077ead6e9617dddc7e474b33240d236478b29c49c76bc7afb7a4b949245/grpcio-1.46.3-cp39-cp39-macosx_10_10_x86_64.whl>
    <https://files.pythonhosted.org/packages/26/7a/73581964003566fea6c87aee21b9305fdf4417917bed87c3744bd048f8e0/grpcio-1.46.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
    <https://files.pythonhosted.org/packages/61/dd/d8eda79197a1275e06621850775c7bbf34a141ff92553754dde4e87d7551/grpcio-1.46.3.tar.gz>
    <https://files.pythonhosted.org/packages/67/95/9abae5e82ef2d57161586755280c14251a6849e64b74d6e7c7dcf8cb7e5e/grpcio-1.46.3-cp39-cp39-linux_armv7l.whl>
    <https://files.pythonhosted.org/packages/9e/f1/1b1b15ac75702f881b46dd2e379201f55ad7ac92aad41b31862e03f54fc7/grpcio-1.46.3-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whl>
    <https://files.pythonhosted.org/packages/aa/97/4a9dade4b4916ad421b4bd3e6af008da9006627cc4543e5586733f2c906e/grpcio-1.46.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl>
    <https://files.pythonhosted.org/packages/e0/69/39608e43e09e22f346033d68fdcc22e0f2671f7e8b46d42a544526966b1d/grpcio-1.46.3-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl>
    <https://files.pythonhosted.org/packages/ea/19/a55de129fab72d279bfee5088a80a07a14fc531e66ff7fd27486873005f8/grpcio-1.46.3-cp39-cp39-musllinux_1_1_i686.whl>
    <https://files.pythonhosted.org/packages/fa/41/71ee690ff1ea6a9c878899c42d2345ecbfdee21e0c39c6edd768d755a5fd/grpcio-1.46.3-cp39-cp39-manylinux_2_17_aarch64.whl>
    requirers:
    via: grpcio==1.46.3
    via: opentelemetry-exporter-otlp-proto-grpc==1.12.0 -> grpcio<2.0.0,>=1.0.0

Dependency on markupsafe not satisfied, 1 incompatible candidate found:
1.) markupsafe 2.0.1 does not have any compatible artifacts:
    <https://files.pythonhosted.org/packages/3b/41/f53e2ac439b309d8bb017d12ee6e7d393aa70c508448c1f30a7e5db9d69e/MarkupSafe-2.0.1-cp39-cp39-musllinux_1_1_x86_64.whl>
    <https://files.pythonhosted.org/packages/50/99/06eccf68be0bff67ab9a0b90b5382c04769f9ad2e42cae5e5e92f99380cd/MarkupSafe-2.0.1-cp39-cp39-manylinux1_x86_64.whl>
    <https://files.pythonhosted.org/packages/5a/ff/34bdcd8cc794f692588de0b3f4c1aa7ec0d17716fda9d874836ed68775c1/MarkupSafe-2.0.1-cp39-cp39-manylinux2010_i686.whl>
    <https://files.pythonhosted.org/packages/66/66/b5891704372c9f5d97432933bdd7e9b5a0647fad9170c72bb7f486550c43/MarkupSafe-2.0.1-cp39-cp39-manylinux1_i686.whl>
    <https://files.pythonhosted.org/packages/67/e9/579a3ad8d48f7680f887ff1f22cc6330f083de23ce32a8fa35f8acef477a/MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_i686.manylinux1_i686.manylinux_2_12_i686.manylinux2010_i686.whl>
    <https://files.pythonhosted.org/packages/6f/83/eabfb8c6d60b096dc9ada378cf935809289c4d0327b74a60789bde77e1db/MarkupSafe-2.0.1-cp39-cp39-manylinux2010_x86_64.whl>
    <https://files.pythonhosted.org/packages/8f/87/4668ce3963e942a9aa7b13212158e74bf063a2461138b7ed5a043ac6aa79/MarkupSafe-2.0.1-cp39-cp39-musllinux_1_1_aarch64.whl>
    <https://files.pythonhosted.org/packages/a6/d1/a7b97d0e000336c4e06bfce7e08dcb2b47fc5091146ee883dfac6cb4842e/MarkupSafe-2.0.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl>
    <https://files.pythonhosted.org/packages/a7/55/a576835b6b95af21d15f69eaf14c4fb1358fd48475f2b9813abd9654132e/MarkupSafe-2.0.1-cp39-cp39-musllinux_1_1_i686.whl>
    <https://files.pythonhosted.org/packages/ae/70/8dd5f2c0aab82431c9c619a2c4fbd1742fc0fb769d8d7b275ae1d03eb3a5/MarkupSafe-2.0.1-cp39-cp39-manylinux2014_aarch64.whl>
    <https://files.pythonhosted.org/packages/bf/10/ff66fea6d1788c458663a84d88787bae15d45daa16f6b3ef33322a51fc7e/MarkupSafe-2.0.1.tar.gz>
    <https://files.pythonhosted.org/packages/c2/db/314df69668f582d5173922bded7b58126044bb77cfce6347c5d992074d2e/MarkupSafe-2.0.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl>
    <https://files.pythonhosted.org/packages/ce/a7/835a636047f4bb4fea31a682c18affad9795e864d800892bd7248485425e/MarkupSafe-2.0.1-cp39-cp39-macosx_10_9_x86_64.whl>
    <https://files.pythonhosted.org/packages/dd/8f/d0c570c851f70377ca6f344531fab4b6b01a99a9d2a801b25d6fd75525e5/MarkupSafe-2.0.1-cp39-cp39-macosx_10_9_universal2.whl>
    requirers:
    via: markupsafe==2.0.1
    via: jinja2==3.0.1 -> MarkupSafe>=2.0

Dependency on wrapt not satisfied, 1 incompatible candidate found:
1.) wrapt 1.14.1 does not have any compatible artifacts:
    <https://files.pythonhosted.org/packages/f9/3c/110e52b9da396a4ef3a0521552a1af9c7875a762361f48678c1ac272fd7e/wrapt-1.14.1-cp39-cp39-musllinux_1_1_x86_64.whl>
    <https://files.pythonhosted.org/packages/0a/61/330f24065b8f2fc02f94321092a24e0c30aefcbac89ab5c860e180366c9f/wrapt-1.14.1-cp39-cp39-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl>
    <https://files.pythonhosted.org/packages/11/eb/e06e77394d6cf09977d92bff310cb0392930c08a338f99af6066a5a98f92/wrapt-1.14.1.tar.gz>
    <https://files.pythonhosted.org/packages/38/38/5b338163b3b4f1ab718306984678c3d180b85a25d72654ea4c61aa6b0968/wrapt-1.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl>
    <https://files.pythonhosted.org/packages/6a/12/76bbe26dc39d05f1a7be8d570d91c87bb79297e08e885148ed670ed17b7b/wrapt-1.14.1-cp39-cp39-musllinux_1_1_i686.whl>
    <https://files.pythonhosted.org/packages/bb/70/73c54e24ea69a8b06ae9649e61d5e64f2b4bdfc6f202fc7794abeac1ed20/wrapt-1.14.1-cp39-cp39-macosx_11_0_arm64.whl>
    <https://files.pythonhosted.org/packages/d9/ab/3ba5816dd466ffd7242913708771d258569825ab76fd29d7fd85b9361311/wrapt-1.14.1-cp39-cp39-macosx_10_9_x86_64.whl>
    <https://files.pythonhosted.org/packages/e0/20/9716fb522d17a726364c4d032c8806ffe312268773dd46a394436b2787cc/wrapt-1.14.1-cp39-cp39-musllinux_1_1_aarch64.whl>
    <https://files.pythonhosted.org/packages/e0/6a/3c660fa34c8106aa9719f2a6636c1c3ea7afd5931ae665eb197fdf4def84/wrapt-1.14.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl>
    requirers:
    via: wrapt==1.14.1
    via: deprecated==1.2.13 -> wrapt<2,>=1.10
    via: opentelemetry-instrumentation==0.33b0 -> wrapt<2.0.0,>=1.0.0

broad-processor-92400

02/07/2023, 10:28 PM

You'll probably want to use a complete platforms JSON file. We've created appropriate files for our docker images by running a PEX command within the file, and then saving it in the repo. https://pantsbuild.slack.com/archives/C046T6T9U/p1670369785794379?thread_ts=1670366698.746769&cid=C046T6T9U

broad-processor-92400

02/07/2023, 10:30 PM

Although, it looks like you have at least one dependency that's source only (no wheels),

blinker

. I believe cross-building requires wheels, and thus you'll need to either: • remove that dependency • build the PEX within the container itself, which I think is possible in the upcoming 2.15 "environments" feature, although I don't know the details

alert-dawn-51425

02/07/2023, 10:31 PM

Thanks for the information

enough-analyst-54434

02/07/2023, 11:53 PM

Pex could implement "yolo" support for this narrow case of foreign

platform

complete_platform

resolution from a lock file. In this case Pex can know when the only matching artifact for the foreign platform is an sdist and attempt to build the sdist and, if successful and the resulting wheel is compatible with the foreign platform, use it. This would allow pure-python projects distributed as sdist-only or only available via VCS to work by rolling the yolo dice and winning.

enough-analyst-54434

03/02/2023, 9:05 PM

The "yolo" support is now available in Pex 2.1.125. You'll need the following

pants.toml

snippet to enable:

Copy code

[pex-cli]
version = "v2.1.125"
known_versions = [
    "v2.1.125|macos_arm64|1da1ef933429f15b218c98c6b960f30adfd0221fc5284c1d8facac09923692f8|4080732",
    "v2.1.125|macos_x86_64|1da1ef933429f15b218c98c6b960f30adfd0221fc5284c1d8facac09923692f8|4080732",
    "v2.1.125|linux_x86_64|1da1ef933429f15b218c98c6b960f30adfd0221fc5284c1d8facac09923692f8|4080732",
    "v2.1.125|linux_arm64|1da1ef933429f15b218c98c6b960f30adfd0221fc5284c1d8facac09923692f8|4080732"
]

🎉 1

9 Views

Open in Slack

Previous Next