https://pantsbuild.org/ logo
Join Slack
Powered by
Hey :wave: trying to get our pipelines optimised ...
# general
g
Hey 👋 trying to get our pipelines optimised on bitbucket (shitbucket) When running the tests it doesnt seem to use the cache that we have set up - (or more likely that I havent set it up correctly) Stack trace in thread 👇
Copy code
06:37:02.71 [INFO] Starting: Building requirements.pex with 6 requirements: boto3==1.26.66, msal==1.21.0, pydantic==1.10.4, pyjwt[crypto]==2.6.0, requests==2.28.2, structlog==22.3.0
06:37:02.73 [INFO] Starting: Building requirements.pex with 2 requirements: boto3==1.26.66, pydantic==1.10.4
06:37:02.72 [INFO] Starting: Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
06:37:02.75 [INFO] Canceled: Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
06:37:02.75 [INFO] Starting: Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
06:37:02.86 [INFO] Canceled: Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
06:37:02.86 [INFO] Starting: Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
06:37:02.92 [INFO] Starting: Building requirements.pex with 3 requirements: boto3==1.26.66, elasticsearch-dsl==7.4.0, pydantic==1.10.4
06:37:02.99 [INFO] Starting: Building requirements.pex with 17 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, elasticsearch-dsl==7.4.0, elasticsearch==7.10.1, faker==16... (191 characters truncated)
06:37:03.04 [INFO] Starting: Building requirements.pex with 7 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, elasticsearch-dsl==7.4.0, elasticsearch==7.10.1, pydantic==1.10.4, requests-aws4auth==1.1.2, structlog==22.3.0
06:37:03.08 [INFO] Starting: Building requirements.pex with 19 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, deepdiff==6.2.3, elasticsearch-dsl==7.4.0, elasticsearch==... (242 characters truncated)
06:37:06.70 [INFO] Starting: Building requirements.pex with 23 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, elasticsearch-dsl==7.4.0, elasticsearch==7... (315 characters truncated)
06:37:42.90 [INFO] Completed: Building requirements.pex with 2 requirements: boto3==1.26.66, pydantic==1.10.4
06:37:42.91 [INFO] Starting: Building requirements.pex with 25 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, deepdiff==6.2.3, elasticsearch-dsl==7.4.0,... (346 characters truncated)
06:37:46.50 [INFO] Completed: Building requirements.pex with 3 requirements: boto3==1.26.66, elasticsearch-dsl==7.4.0, pydantic==1.10.4
06:37:46.50 [INFO] Starting: Building requirements.pex with 24 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, elasticsearch-dsl==7.4.0, elasticsearch==7... (335 characters truncated)
06:37:46.63 [INFO] Completed: Building requirements.pex with 7 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, elasticsearch-dsl==7.4.0, elasticsearch==7.10.1, pydantic==1.10.4, requests-aws4auth==1.1.2, structlog==22.3.0
06:37:46.66 [INFO] Canceled: Building requirements.pex with 24 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, elasticsearch-dsl==7.4.0, elasticsearch==7... (335 characters truncated)
06:37:46.66 [INFO] Starting: Building requirements.pex with 24 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, elasticsearch-dsl==7.4.0, elasticsearch==7... (335 characters truncated)
06:37:49.97 [INFO] Completed: Building requirements.pex with 6 requirements: boto3==1.26.66, msal==1.21.0, pydantic==1.10.4, pyjwt[crypto]==2.6.0, requests==2.28.2, structlog==22.3.0
06:38:05.50 [INFO] Completed: Building requirements.pex with 17 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, elasticsearch-dsl==7.4.0, elasticsearch==7.10.1, faker==16... (191 characters truncated)
06:38:07.61 [INFO] Completed: Building requirements.pex with 19 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, deepdiff==6.2.3, elasticsearch-dsl==7.4.0, elasticsearch==... (242 characters truncated)
06:38:24.91 [INFO] Completed: Building requirements.pex with 23 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, elasticsearch-dsl==7.4.0, elasticsearch==7... (315 characters truncated)
06:38:29.13 [INFO] Long running tasks:
  86.27s	Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
06:38:31.13 [INFO] Completed: Building requirements.pex with 25 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, deepdiff==6.2.3, elasticsearch-dsl==7.4.0,... (346 characters truncated)
06:38:31.81 [INFO] Completed: Building requirements.pex with 24 requirements: aws-xray-sdk==2.11.0, boto3==1.26.66, botocore==1.29.66, cryptography==39.0.1, dacite==1.8.0, ddtrace==1.7.4, elasticsearch-dsl==7.4.0, elasticsearch==7... (335 characters truncated)
06:38:59.14 [INFO] Long running tasks:
  116.28s	Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
06:39:00.59 [INFO] Completed: Building pytest.pex with 11 requirements: jsonschema, moto, moto[all], numpy, pandas, pillow, pytest-asyncio, pytest-cov!=2.12.1,<3.1,>=2.12, pytest==7.0.1, pyyaml, respx
Cache:
Copy code
pants-setup: ~/.cache/pants/setup
    pants-named-cache: ~/.cache/pants/named_caches
    pants-lmdb-cache: ~/.cache/pants/lmdb_store
b
Does this behaviour happen for two builds of exactly the same code? What's the size of 
~/.cache/pants/lmdb_store
just before that test run?
Open in Slack
PreviousNext
Powered by