Hello Everyone I am facing some issue while runni...
# development
a
Hello Everyone I am facing some issue while running pants "*./pants update-build-files fix fmt lint check ::* " on WSL. despite I have stable internet connection, the pyspark 3.5 is not being download, however I curl url on terminal, the dependency get download. logs are as below 104020.85 [INFO] No required changes to BUILD files found.However, there may still be deprecations that
update-build-files
doesn't know how to fix. See https://www.pantsbuild.org/v2.18/docs/upgrade-tips for upgrade tips. 104020.93 [INFO] Completed: Format with shfmt - shfmt made no changes. 104020.94 [INFO] Completed: Fix with pyupgrade - pyupgrade made no changes. 104020.95 [INFO] Completed: Fix with pyupgrade - pyupgrade made no changes. 104020.96 [INFO] Completed: Format with docformatter - docformatter made no changes. 104020.96 [INFO] Completed: Format with isort - isort made no changes. 104020.96 [INFO] Completed: Fix with pyupgrade - pyupgrade made no changes. 104020.97 [INFO] Completed: Format with isort - isort made no changes. 104020.97 [INFO] Completed: Format with Black - black made no changes. 104020.97 [INFO] Completed: Format with isort - isort made no changes. 104021.02 [INFO] Completed: Format with Black - black made no changes. 104021.61 [INFO] Completed: Lint with Hadolint - hadolint succeeded. 104021.71 [INFO] Completed: Lint with Flake8 - flake8 succeeded. Partition: ['CPython==3.10.*'] 104021.71 [INFO] Completed: Lint with Flake8 - flake8 succeeded. Partition: ['CPython==3.10.*'] 104021.71 [INFO] Completed: Lint with Flake8 - flake8 succeeded. Partition: ['CPython==3.10.*'] 104021.71 [INFO] Completed: Lint with Flake8 - flake8 succeeded. Partition: ['CPython==3.10.*'] 104021.71 [INFO] Completed: Lint with Flake8 - flake8 succeeded. Partition: ['CPython==3.10.*'] 104021.72 [INFO] Completed: Lint with Flake8 - flake8 succeeded. Partition: ['CPython==3.10.*'] 104021.75 [INFO] Completed: Lint with Shellcheck - shellcheck succeeded. 104127.00 [INFO] Extending leases 104127.87 [INFO] Done extending leases 104138.86 [INFO] Completed: Building 13 requirements for requirements.pex from the 3rdparty/python/default.lock resolve: JSON-log-formatter==0.5.2, beautifulsoup4==4.12.2, boto3, pandas==2.2.1, paramiko==3.4.0, py4j, pyspark==3.... (90 characters truncated) 104138.88 [31m[ERROR][0m 1 Exception encountered: Engine traceback: in
lint
goal ProcessExecutionFailure: Process 'Building 13 requirements for requirements.pex from the 3rdparty/python/default.lock resolve: JSON-log-formatter==0.5.2, beautifulsoup4==4.12.2, boto3, pandas==2.2.1, paramiko==3.4.0, py4j, pyspark==3.5.0, pytest, requests==2.31.0, selenium==4.2.0, types-paramiko, types-pytz, types-requests' failed with exit code 1. stdout: stderr: There was 1 error downloading required artifacts: 1. pyspark 3.5 from https://files.pythonhosted.org/packages/92/11/5c0f24537fa68624cb6271d2a8a8982e81bd05f5cb51e9d2d2a89baa0e1a/pyspark-3.5.0.tar.gz pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out. Use
--keep-sandboxes=on_failure
to preserve the process chroot for inspection.
c
are you able to install it with pip?
pip3 install pyspark==3.5.0
, and then try again with pants? pip and curl have different retry and timeout algorithms, and I've found that curl is much more lenient.
h
Hi, this channel is for discussion of development of Pants itself, the right place for this sort of question is #general, and I see you've asked it there, so this is just FYI for next time... 🙂