https://pantsbuild.org/ logo
Powered by
#general
  • w

    witty-crayon-22786

    02/07/2017, 7:13 PM
    ie, if you build 
    ./pants test my-target
    repeatedly, it will only go to the network the first time
  • w

    witty-crayon-22786

    02/07/2017, 7:14 PM
    if you change to building 
    ./pants test my-target-2
    , it might need to go to the network
  • w

    witty-crayon-22786

    02/07/2017, 7:14 PM
    or, if you change the dependencies of 
    my-target
    .
  • b

    bright-apartment-76721

    02/07/2017, 7:14 PM
    what about non-java projects? is that roughly the pattern for python dependencies too, for example?
  • w

    witty-crayon-22786

    02/07/2017, 7:15 PM
    it should be the case for python projects too, yes. but i'm less sure.
  • b

    bright-apartment-76721

    02/07/2017, 7:16 PM
    for example, I see --ivy-http[s]-proxy config options, but not something similar for pip
  • b

    bright-apartment-76721

    02/07/2017, 7:16 PM
    perhaps I do that through an environment variable
  • w

    witty-crayon-22786

    02/07/2017, 7:16 PM
    they're not using a universal http transport
  • b

    bright-apartment-76721

    02/07/2017, 7:17 PM
    it looks like both requests and ivy will respect HTTP[S]_PROXY variables
  • b

    bright-apartment-76721

    02/07/2017, 7:20 PM
    cool, I think that's working
  • b

    bright-apartment-76721

    02/07/2017, 7:23 PM
    what's the conceptual difference between .pants.d and the shared cache folder?
  • w

    witty-crayon-22786

    02/07/2017, 7:24 PM
    .pants.d is the extracted "current" state
  • w

    witty-crayon-22786

    02/07/2017, 7:24 PM
    and is mutable
  • w

    witty-crayon-22786

    02/07/2017, 7:24 PM
    the shared cache is append only
  • w

    witty-crayon-22786

    02/07/2017, 7:24 PM
    and safe for sharing
  • w

    witty-crayon-22786

    02/07/2017, 7:24 PM
    it should never be necessary to wipe the shared cache, or else it's a critical bug
  • b

    bright-apartment-76721

    02/07/2017, 7:25 PM
    ah. Will per-file recompilation avoidance use .pants.d or the shared cache? I.e., if I share my ~/.cache/pants with someone else and I'd already compiled foo.scala locally, will it recompile that on the machine I shared it with?
  • w

    witty-crayon-22786

    02/07/2017, 7:25 PM
    if it's necessary to wipe pants.d, it's ... a slightly less critical bug. as we can't really trust zinc or pex in all cases
  • w

    witty-crayon-22786

    02/07/2017, 7:25 PM
    zinc incremental compiles aren't cached
  • w

    witty-crayon-22786

    02/07/2017, 7:26 PM
    but other than that: yes.
  • w

    witty-crayon-22786

    02/07/2017, 7:27 PM
    so, to ensure that everything gets cached, you can either run 
    clean-all
    immediately before building, or you can disable zinc incremental compiles with 
    --no-compile-zinc-incremental
  • w

    witty-crayon-22786

    02/07/2017, 7:27 PM
    (we disable 
    incremental
    in CI to maximize what gets written to the cache)
  • b

    bright-apartment-76721

    02/07/2017, 7:27 PM
    hmm, let me think a sec
  • b

    bright-apartment-76721

    02/07/2017, 7:28 PM
    so in the scenario I gave earlier, if I have a project with 100k scala files (all horribly slow) and chug through it and then share my pants cache with a colleague and he edits just one file in that project
  • b

    bright-apartment-76721

    02/07/2017, 7:28 PM
    is that the zinc incremental compile thing you're talking about?
  • w

    witty-crayon-22786

    02/07/2017, 7:29 PM
    zinc primarily comes into play for sub-target incrementalism
  • w

    witty-crayon-22786

    02/07/2017, 7:29 PM
    pants implements per-target incrementalism (i changed one target, so only targets that depend on it are re-built)
  • w

    witty-crayon-22786

    02/07/2017, 7:29 PM
    once pants has decided to ask zinc to compile a target, zinc's per-file incrementalism comes into play
  • w

    witty-crayon-22786

    02/07/2017, 7:30 PM
    cache artifacts are per-target
  • w

    witty-crayon-22786

    02/07/2017, 7:30 PM
    more targets == better
1...162516261627...2420Latest