https://pantsbuild.org/ logo
Powered by
#general
  • e

    enough-analyst-54434

    01/25/2017, 10:33 PM
    k
  • e

    enough-analyst-54434

    01/25/2017, 10:33 PM
    And you verified rm -rf worked?
  • e

    enough-analyst-54434

    01/25/2017, 10:33 PM
    IIRC OSX will silent on root owned
  • e

    enough-analyst-54434

    01/25/2017, 10:33 PM
    Had tweeps have root owned stuff
  • m

    mysterious-action-44812

    01/25/2017, 10:34 PM
    Copy code
    ~/c/aiq-pants (master|✚4…) $ ls -la ~/.ivy2/
total 24
drwxr-xr-x   10 nitay  staff    340 Jan 25 17:33 .
drwxr-xr-x   33 nitay  staff   1122 Dec 29 17:05 ..
-rw-r--r--    1 nitay  staff    106 Jul 25  2016 .gitignore
-rw-r--r--    1 nitay  staff      0 Dec 24 11:51 .sbt.cache.lock
-rw-r--r--    1 nitay  staff      0 Jan 19 10:17 .sbt.ivy.lock
drwxr-xr-x  324 nitay  staff  11016 Jan 22 01:15 cache
-rw-r--r--    1 nitay  staff   4372 Jan 19 10:17 exclude_classifiers
-rw-r--r--    1 nitay  staff      0 Jan 19 10:17 exclude_classifiers.lock
drwxr-xr-x  115 nitay  staff   3910 Aug  9 13:37 jars
drwxr-xr-x    4 nitay  staff    136 Sep  9 22:12 local
  • m

    mysterious-action-44812

    01/25/2017, 10:34 PM
    (no pants after rm -rf)
  • e

    enough-analyst-54434

    01/25/2017, 10:36 PM
    Does your nailgun have 
    -Dsun.io.useCanonCaches=false
    ?
  • m

    mysterious-action-44812

    01/25/2017, 10:36 PM
    this what ure looking for in terms of nailgun: 
    501 54101     1   0 Sat11PM ??         2:20.81 /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/bin/java -Xmx256m -Dpants.buildroot=/Users/nitay/code/aiq-pants -Dpants.nailgun.owner=/Users/nitay/code/aiq-pants/.pants.d/ng/BinaryCreate_binary_jvm -Dpants.nailgun.fingerprint=eb9169c2a12686293ed8f2d8261b483a5d43e592 -cp .pants.d/ivy/jars/com.martiansoftware/nailgun-server/jars/nailgun-server-0.9.1.jar:.pants.d/ivy/jars/org.pantsbuild/jar-tool/jars/jar-tool-0.0.10.jar:.pants.d/ivy/jars/org.pantsbuild/args4j/jars/args4j-0.0.9.jar:.pants.d/ivy/jars/args4j/args4j/bundles/args4j-2.32.jar:.pants.d/ivy/jars/com.google.guava/guava/bundles/guava-18.0.jar:.pants.d/ivy/jars/com.google.code.findbugs/jsr305/jars/jsr305-3.0.0.jar com.martiansoftware.nailgun.NGServer :0
  • e

    enough-analyst-54434

    01/25/2017, 10:36 PM
    it does not then
  • e

    enough-analyst-54434

    01/25/2017, 10:36 PM
    so - that relates to symlinks working
  • m

    mysterious-action-44812

    01/25/2017, 10:37 PM
    i do see that option on some of the ps lines
  • e

    enough-analyst-54434

    01/25/2017, 10:37 PM
    focus on the ivy nailgun
  • m

    mysterious-action-44812

    01/25/2017, 10:37 PM
    there’s a bunch of ps nailguns, must be bunch of forking? which one u want
  • m

    mysterious-action-44812

    01/25/2017, 10:38 PM
    ok must be this right? 
    /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/bin/java -Xmx256m -Dsun.io.useCanonCaches=false -Divy.cache.dir=/Users/nitay/.ivy2/pants -Dpants.buildroot=/Users/nitay/code/aiq -Dpants.nailgun.owner=/Users/nitay/code/aiq/.pants.d/ng/IvyResolve_resolve_ivy -Dpants.nailgun.fingerprint=09177327ddbd7352a00458d48e7955e15180c7f1 -cp .pants.d/ivy/jars/com.martiansoftware/nailgun-server/jars/nailgun-server-0.9.1.jar:../dotfiles/automated/ivy2/pants/org.apache.ivy/ivy/jars/ivy-2.4.0.jar:../dotfiles/automated/ivy2/pants/co.actioniq/s3-ivy-resolver/jars/s3-ivy-resolver-0.2.jar:../dotfiles/automated/ivy2/pants/com.amazonaws/aws-java-sdk-core/jars/aws-java-sdk-core-1.10.69.jar:../dotfiles/automated/ivy2/pants/commons-logging/commons-logging/jars/commons-logging-1.2.jar:../dotfiles/automated/ivy2/pants/org.apache.httpcomponents/httpclient/jars/httpclient-4.3.6.jar:../dotfiles/automated/ivy2/pants/org.apache.httpcomponents/httpcore/jars/httpcore-4.3.3.jar:../dotfiles/automated/ivy2/pants/commons-codec/commons-codec/jars/commons-codec-1.10.jar:../dotfiles/automated/ivy2/pants/com.fasterxml.jackson.core/jackson-databind/bundles/jackson-databind-2.5.3.jar:../dotfiles/automated/ivy2/pants/com.fasterxml.jackson.core/jackson-annotations/bundles/jackson-annotations-2.5.3.jar:../dotfiles/automated/ivy2/pants/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.5.3.jar:../dotfiles/automated/ivy2/pants/com.fasterxml.jackson.dataformat/jackson-dataformat-cbor/bundles/jackson-dataformat-cbor-2.5.3.jar:../dotfiles/automated/ivy2/pants/joda-time/joda-time/jars/joda-time-2.8.1.jar:../dotfiles/automated/ivy2/pants/com.amazonaws/aws-java-sdk-s3/jars/aws-java-sdk-s3-1.10.69.jar:../dotfiles/automated/ivy2/pants/com.amazonaws/aws-java-sdk-kms/jars/aws-java-sdk-kms-1.10.69.jar:../dotfiles/automated/ivy2/pants/com.amazonaws/aws-java-sdk-sts/jars/aws-java-sdk-sts-1.10.69.jar:../dotfiles/automated/ivy2/pants/commons-httpclient/commons-httpclient/jars/commons-httpclient-3.1.jar com.martiansoftware.nailgun.NGServer :0
  • m

    mysterious-action-44812

    01/25/2017, 10:38 PM
    nailgun.owner = … ivy ...
  • e

    enough-analyst-54434

    01/25/2017, 10:39 PM
    yup right one and does have the symlink relevant flag
  • e

    enough-analyst-54434

    01/25/2017, 10:42 PM
    No clue then. The only difference remaining I can concoct between a subprocess spawned ivy resolve and a nailguned ivy resolve would be classpath - with different ordering in the NG, and flaky different ordering at that... or masked oom errors in the nailgun, though that flake would be of the style - once the ng flakes once it flakes forever until killed
  • e

    enough-analyst-54434

    01/25/2017, 10:43 PM
    What is the nature of the NG failures - always, flaky or once flaky, then always?
  • m

    mysterious-action-44812

    01/25/2017, 10:43 PM
    once flaky then always
  • e

    enough-analyst-54434

    01/25/2017, 10:43 PM
    That points to oomish guess
  • e

    enough-analyst-54434

    01/25/2017, 10:44 PM
    You could try upping -Xmx256m by x4 and seeing if 1st flake takes notably longer
  • e

    enough-analyst-54434

    01/25/2017, 10:44 PM
    Or you could skip straight to diabling nailguns for ivy
  • e

    enough-analyst-54434

    01/25/2017, 10:44 PM
    Pretty sure you can still do this on a per ng basis via pants.ini
  • e

    enough-analyst-54434

    01/25/2017, 10:45 PM
    Copy code
    $ ./pants options | grep ivy | grep use_nailgun
imports.ivy-imports.use_nailgun = True (from HARDCODED)
resolve.ivy.use_nailgun = True (from HARDCODED)
  • e

    enough-analyst-54434

    01/25/2017, 10:45 PM
    So that 2nd one [resolve.ivy] use_nailgun = False
  • m

    mysterious-action-44812

    01/25/2017, 10:45 PM
    ye i set second one to false, whast the first?
  • m

    mysterious-action-44812

    01/25/2017, 10:46 PM
    thats what fixed it, setting the second one
  • e

    enough-analyst-54434

    01/25/2017, 10:46 PM
    I do not remember the 1st
  • e

    enough-analyst-54434

    01/25/2017, 10:46 PM
    So, we spent a good deal of time here and my only good idea was a leak and oom
  • e

    enough-analyst-54434

    01/25/2017, 10:46 PM
    If you have time to confirm, that would be awesome
1...160816091610...2420Latest