https://pantsbuild.org/ logo
Powered by
#development
  • a

    aloof-angle-91616

    10/22/2019, 3:03 AM
    add 
    --no-process-execution-cleanup-local-dirs
    and then check stderr for the path to the directory
  • a

    aloof-angle-91616

    10/22/2019, 3:04 AM
    can also run with 
    -ldebug
    , observe the 
    input_files
    argument to the 
    ExecuteProcessRequest
    , then request it out of the local cas with 
    src/rust/engine/target/debug/fs_util
  • h

    happy-kitchen-89482

    10/22/2019, 3:04 AM
    ooh, this is good stuff
  • h

    happy-kitchen-89482

    10/22/2019, 3:04 AM
    pro tips
  • a

    aloof-angle-91616

    10/22/2019, 3:04 AM
    YEP!!!
  • a

    aloof-angle-91616

    10/22/2019, 3:05 AM
    one thing i want to do is add a bootstrap option which displays `ExecuteProcessRequest`s in 
    -ldebug
    output as just ready-to-repro complete 
    process_executor
    command lines
  • a

    aloof-angle-91616

    10/22/2019, 3:05 AM
    have used this to great effect in the past
  • h

    happy-kitchen-89482

    10/22/2019, 3:07 AM
    that would be really useful
    👍 1
  • h

    happy-kitchen-89482

    10/22/2019, 3:07 AM
    as it is I'm able to cobble together the full cmd line from that output
  • h

    happy-kitchen-89482

    10/22/2019, 3:07 AM
    And it takes 4 seconds to run, then errors on some "no module named" error
  • h

    happy-kitchen-89482

    10/22/2019, 3:08 AM
    Oh wait, this is a merged pex situation
  • h

    happy-kitchen-89482

    10/22/2019, 3:13 AM
    So I need to get the input files as well
  • h

    happy-kitchen-89482

    10/22/2019, 3:13 AM
    From the cas
  • h

    happy-kitchen-89482

    10/22/2019, 3:17 AM
    I have the digest, and size
  • h

    happy-kitchen-89482

    10/22/2019, 3:17 AM
    running 
    src/rust/engine/target/debug/fs_util cat bf08411ed80e316259a61368434b7c868b8c6c0e85f5e403dbffe19d12f19a9c 273
  • a

    aloof-angle-91616

    10/22/2019, 3:17 AM
    oh yeah
  • h

    happy-kitchen-89482

    10/22/2019, 3:17 AM
    gives me what looks like a serialized proto or something?
  • a

    aloof-angle-91616

    10/22/2019, 3:17 AM
    the arguments are
  • h

    happy-kitchen-89482

    10/22/2019, 3:18 AM
    That digest is the digest of the argument to 
    input_files
  • h

    happy-kitchen-89482

    10/22/2019, 3:18 AM
    So I guess it represents a directory
  • a

    aloof-angle-91616

    10/22/2019, 3:18 AM
    the one i use is 
    src/rust/engine/target/debug/fs_util directory cat-proto --output-format recursive-file-list-with-digests bf08411ed80e316259a61368434b7c868b8c6c0e85f5e403dbffe19d12f19a9c 273
  • h

    happy-kitchen-89482

    10/22/2019, 3:19 AM
    How do I splat that directory out to disk somewhere?
  • h

    happy-kitchen-89482

    10/22/2019, 3:19 AM
    Ah
  • a

    aloof-angle-91616

    10/22/2019, 3:19 AM
    the nested arguments are not very discoverable imho
    a
    • 2
    • 5
  • a

    aloof-angle-91616

    10/22/2019, 3:19 AM
    fs_util materialize
    splats it out to disk somewhere
  • h

    happy-kitchen-89482

    10/22/2019, 3:21 AM
    nice
  • h

    happy-kitchen-89482

    10/22/2019, 3:21 AM
    OK so running the tests directly from that splatted dir takes ~4 seconds of overhead, instead of 10.
  • h

    happy-kitchen-89482

    10/22/2019, 3:21 AM
    Still more than I would expect.
  • a

    aloof-angle-91616

    10/22/2019, 3:22 AM
    is pyc compilation likely to be relevant here?
  • h

    happy-kitchen-89482

    10/22/2019, 3:22 AM
    I'd be a bit surprised
    👍 1
1...665666667...906Latest