https://pantsbuild.org/ logo
Powered by
#general
  • w

    witty-crayon-22786

    02/28/2017, 6:42 PM
    i suspect that the AWS issues have caused the latest master to break, rather than the patch itself? retrying.
  • p

    purple-oil-45048

    03/01/2017, 1:51 AM
    in your pants mono-repos .. do you also tend to have infra-structure related settings such as chef, ansible, ..? or do you keep these normally on separate trees?
  • a

    aloof-painter-75660

    03/01/2017, 9:43 AM
    @astonishing-jelly-60479 yeah, I'm using a clean .pants.d folder every time, but I did setup an nginx dav cache server, which upon inspection only seems to cache binaries, not any python_library objects (which I assume get built as wheels and packed into the pex).
  • a

    aloof-painter-75660

    03/01/2017, 10:19 AM
    I thought even the chroot could be cached, to speed up subsequent builds (like it does with your local .pants.d) but that does not seem to be the case. Can someone confirm that this (only caching binaries) is how it should work?
  • p

    purple-oil-45048

    03/01/2017, 3:27 PM
    I have a very basic 
    test.specs2
    task working that uses spec2's runner directly as opposed to running it via junit. I am wondering if this could be something for 
    pants-contrib
    ？
  • a

    astonishing-jelly-60479

    03/01/2017, 3:34 PM
    @aloof-painter-75660 the chroots are cached, but they're cached in .pants.d and not in the pants artifact cache last time i checked
  • a

    aloof-painter-75660

    03/01/2017, 3:34 PM
    yeah, that's what I noticed ... I was hoping some intermediate artifacts (python_library's) would be stored there as well
  • a

    astonishing-jelly-60479

    03/01/2017, 3:34 PM
    we had to jump through a lot of hoops with our CI setup to get to a point where python test runs/builds were performant, we share a lot of caches between runs, which sometimes results in problems due to bad fingerprinting, etc., but at least it's performant
  • a

    aloof-painter-75660

    03/01/2017, 3:35 PM
    Currently I'm investigating caching .pants.d and sharing between builds
  • a

    aloof-painter-75660

    03/01/2017, 3:35 PM
    but I was hopeful that the artifact build cache would be more useful, and helpful for our local developers as well
  • w

    wide-energy-11069

    03/01/2017, 8:18 PM
    PSA:
    We're experiencing a partial API outage, which is affecting logs availability and our web performance for public repositories. Please refer to traviscistatus.com for more details.
  • f

    full-kilobyte-93429

    03/01/2017, 8:20 PM
    looks still to do with aws...
    Our ongoing database connection issues are due to emergency maintenance following the recent AWS outage.
  • w

    witty-crayon-22786

    03/01/2017, 8:22 PM
    @aloof-painter-75660 , @astonishing-jelly-60479 : @happy-kitchen-89482 is currently overhauling the python pipeline to actually allow it to use the build cache
  • h

    happy-kitchen-89482

    03/01/2017, 8:22 PM
    Yes, and it works really well btw
  • h

    happy-kitchen-89482

    03/01/2017, 8:23 PM
    It’s one code review away from being usable (two if you want setup.py support…)
  • h

    happy-kitchen-89482

    03/01/2017, 8:23 PM
    The old python pipeline does have its own caching of chroots
  • h

    happy-kitchen-89482

    03/01/2017, 8:23 PM
    but it’s clunkier
  • w

    witty-crayon-22786

    03/01/2017, 8:29 PM
    sorry that we've been slow on reviews... all trying to get stuff stabilized before i got on vacation, and then before the end of the quarter
  • a

    aloof-painter-75660

    03/01/2017, 10:12 PM
    Wow, that's exciting, is there a PR I can watch somewhere to know when it gets merged? 🙂
  • w

    witty-crayon-22786

    03/01/2017, 10:15 PM
    yes, lots of them. https://github.com/pantsbuild/pants/pull/4252 is the most recent. (edit: fixed link)
  • h

    happy-kitchen-89482

    03/01/2017, 10:17 PM
    @aloof-painter-75660 if you want to be the guinea pig for this, that would be awesome
  • a

    aloof-painter-75660

    03/01/2017, 10:17 PM
    Yes please
  • a

    aloof-painter-75660

    03/01/2017, 10:18 PM
    I'll check out the branch
  • a

    aloof-painter-75660

    03/01/2017, 10:18 PM
    and try it out
  • h

    happy-kitchen-89482

    03/01/2017, 10:18 PM
    I’d wait a little longer
  • h

    happy-kitchen-89482

    03/01/2017, 10:19 PM
    I still need to make it easy to choose to use it
  • a

    astonishing-jelly-60479

    03/01/2017, 10:19 PM
    @happy-kitchen-89482 any thoughts on splitting out internal and external python dependencies into separate chroots and then logically joining them together? we spend a lot of time re-chrooting external python dependencies that rarely change
  • h

    happy-kitchen-89482

    03/01/2017, 10:19 PM
    That is exactly what the new pipeline does
  • h

    happy-kitchen-89482

    03/01/2017, 10:20 PM
    Only the source chroot changes if you only change sources
  • h

    happy-kitchen-89482

    03/01/2017, 10:20 PM
    and that’s v. fast
1...165216531654...2420Latest