Hello All. Weird issue we're having. When we're ru...
# generalk
kind-hydrogen-975
05/17/2022, 5:06 PMHello All. Weird issue we're having. When we're running
./pants test <some_app_that_puts_files_to_s3>✅ 1
p
polite-garden-50641
05/17/2022, 5:15 PMpolite-garden-50641
05/17/2022, 5:16 PMh
hundreds-father-404
05/17/2022, 5:22 PMHi there! indeed, see https://www.pantsbuild.org/docs/python-test-goal#setting-environment-variables for a guide about this
k
kind-hydrogen-975
05/17/2022, 5:23 PMthanks a lot all, will try 🙂
kind-hydrogen-975
05/17/2022, 5:24 PMalthough.. why is it running locally? shouldn't it behave the same?
p
polite-garden-50641
05/17/2022, 5:24 PMyes. this is weird... I would expect it to fail locally.... @hundreds-father-404?
k
kind-hydrogen-975
05/17/2022, 5:26 PMi know that lerna for example has this.. CI detection thing, so there's the potential of a bit of a different run between local and CI. but i haven't seen aything of the sort with pants.
h
hundreds-father-404
05/17/2022, 5:27 PMyeah I would expect it to fall in both! I wonder if the test is written to behave differently depending on CI, perhaps?
k
kind-hydrogen-975
05/17/2022, 5:28 PMwelp it doesn't 🙂 i reset everything. i delete the caches, remove dists, removed .pants.d, killed the process.. same exact git repo, same exact commit. CI fails, local works 🤔
kind-hydrogen-975
05/17/2022, 5:31 PMim wondering how boto3 looks for credentials. We're not setting any interesting envvars, so im thinking more of filesystem direction. when the test runs, it first builds the pex and then runs it from an alternate "root" right? so maybe it doesn't find .aws there? still doesn't explain the discrepency between CI and local, but i think that's the direction for further investigation
p
polite-garden-50641
05/17/2022, 5:32 PMyes. boto3 will lookup creds in multiple places, not just env variables.
so it is possible that when u run locally it is able to grab it from elsewhere. for example from
~/.aws/credentialspolite-garden-50641
05/17/2022, 5:33 PMk
kind-hydrogen-975
05/17/2022, 5:34 PMhmm that's interesting actually. now that i think of it, maybe the aws credentials are provided with env-vars inside CircleCI's environment, but locally we have the ~/.aws/credentials directories
kind-hydrogen-975
05/17/2022, 5:34 PMok that's a good direction... checking the reference you gave me before about the env vars, thanks!
p
polite-garden-50641
05/17/2022, 5:34 PMtry renaming that file locally (if u have it) and see if the test still passes.
k
kind-hydrogen-975
05/17/2022, 5:34 PMwill report..
kind-hydrogen-975
05/17/2022, 5:34 PMhmm good diea
kind-hydrogen-975
05/17/2022, 5:34 PMidea*
kind-hydrogen-975
05/17/2022, 5:35 PMbreaks!
p
polite-garden-50641
05/17/2022, 5:35 PMif u have logging from boto3 (this is botocore) enabled it will log where it got the creds from: https://github.com/boto/botocore/blob/f2b0dbb800b8dc2a3541334d5ca1190faf900150/botocore/credentials.py#L1303
k
kind-hydrogen-975
05/17/2022, 5:35 PMvery cool, so it's probably the env vars being removed on CircleCI...
kind-hydrogen-975
05/17/2022, 5:35 PMahh nice i'll try that too, thank you very much!
p
polite-garden-50641
05/17/2022, 5:37 PMboto והשטויות שלו
😆 1
k
kind-hydrogen-975
05/17/2022, 5:37 PMheheh naa it's my fault.. for some reason i was sure that we're also using file based auth on circle
kind-hydrogen-975
05/17/2022, 5:38 PMthat - coupled with my very basic (for now) pantsbuild knowledge..
kind-hydrogen-975
05/17/2022, 5:43 PMWORKS!
kind-hydrogen-975
05/17/2022, 5:43 PMThank you so much @polite-garden-50641 and @hundreds-father-404
❤️ 1
🔥 1
kind-hydrogen-975
05/17/2022, 5:43 PM🙏
4 Views