Ergonomic, hermetic, user-friendly software build system for Python, Go, Java, Kotlin, Protobuf, Scala, Shell. Pants lets you fearlessly scale up your codebase!

Pants

oh need to remove .ivy2/pants? i was just removing .cache and .pants.d in the repo

essentially the cmd i keep running to test it is `rm -rf .cache .pants.d; ./pants resolve.ivy auth/src/main/scala/co/actioniq/auth:`

where auth is sth that pulls in our s3 jar

But yes, remove ~/.ivy2/pants/[org]/[name] for all bad ones, or, as you say - the whol ~/.ivy2/pants

Now when the descriptor download flakes, the build should fail

<https://gist.github.com/nitay/eddcb2d7bbd223c584af0943a003ec2a>

There is a lot of output there including nice sold S3 errors, can you narrow to what you expected vs what the log shows?

ye i wasnt sure what helps u understand it - the problem starts at ` UNRESOLVED DEPENDENCIES `

essentially the spark stuff is our own version of spark, one of the things we host in s3

that seems to fail b/c of its transitive deps

and the logs above show you don't host them in s3 where you think you do

everything else is not, the other stuff it should get from maven

```
~ $ aws s3 ls <s3://aiq-artifacts/releases/co/actioniq/spark/spark-core_2.11/2.0.2-aiq28-2.11.8/spark-core_2.11-2.0.2-aiq28-2.11.8.pom>
2017-01-24 22:15:32      24515 spark-core_2.11-2.0.2-aiq28-2.11.8.pom
2017-01-24 22:15:33         32 spark-core_2.11-2.0.2-aiq28-2.11.8.pom.md5
2017-01-24 22:15:33         40 spark-core_2.11-2.0.2-aiq28-2.11.8.pom.sha1```

what about: <s3://s3.amazonaws.com/aiq-artifacts/releases/co/actioniq/spark/spark-sql_2.11/2.0.2-aiq28-2.11.8/spark-sql_2.11-2.0.2-aiq28-2.11.8.pom>

i had to remove `<http://s3.amazonaws.com|s3.amazonaws.com>` at beginning but i dont think that’s an issue?

if i remove that host from resolver config in ivysettings.xml i get `                     		:: co.actioniq.spark#spark-hive_2.11;2.0.2-aiq28-2.11.8: Invalid S3 URI: hostname does not appear to be a valid S3 endpoint: <https://aiq-artifacts/releases/co/actioniq/spark/spark-hive_2.11/2.0.2-aiq28-2.11.8/spark-hive_2.11-2.0.2-aiq28-2.11.8.pom>`

Well, you have 3 of these:
<s3://s3.amazonaws.com/aiq-artifacts/releases/co/actioniq/spark/spark-repl_2.11/2.0.2-aiq28-2.11.8/spark-repl_2.11-2.0.2-aiq28-2.11.8.pom>

                     		module not found: co.actioniq.spark#spark-sql_2.11;2.0.2-aiq28-2.11.8

Given those 3 not founds as you've explained things, they are nowhere else and so the resolve should fail

i mean it is there, as u see above, it just sometimes works sometimes not i dont understand why?