pantsbuild #general

Hi - I’m looking to write a task that generates files that are included as resources on the classpath and in jar files. I’ve seen some discussion of these recently. Are there any examples to follow that do something like this? I’m trying to do it as a

SimpleCodegenTask

that generates

Resources

as its

synthetic_target_type

straight-waiter-86090

02/14/2017, 1:44 PM

it seems to create the files in

.pants.d

but not in the jar.

straight-waiter-86090

02/14/2017, 1:45 PM

if there was an example of a task doing something similar I would use it as a starting point.

purple-oil-45048

02/14/2017, 2:17 PM

@straight-waiter-86090 yeah I’ve been looking into something like this for the past week. https://github.com/suls/pants-generated-resources is almost the solution .. Where it currently breaks down is shown in https://travis-ci.org/suls/pants-generated-resources .. Long story short, as long as you don’t do

--bundle-jvm-deployjar

the github repo is your thing. If you need a single-jar, you need to go down the synthetic target road .. which I have not done yet

straight-waiter-86090

02/14/2017, 2:22 PM

ok great, I’ll try this and see how it goes. Thank you.

straight-waiter-86090

02/14/2017, 2:26 PM

Copy code

➜  pants-generated-resources git:(master) jar tf dist/src.java.org.suls.pants.app-bundle/libs/src.java.org.suls.pants.app-0.jar 
META-INF/
META-INF/MANIFEST.MF
generated.properties

straight-waiter-86090

02/14/2017, 2:27 PM

looks like it’s doing what I would expect, including generated.properties into the `jvm_app`’s jar.

straight-waiter-86090

02/14/2017, 2:27 PM

this should work for me.

purple-oil-45048

02/14/2017, 2:28 PM

👍

straight-waiter-86090

02/14/2017, 2:43 PM

one thing I’d like to figure out is how to make use of a target to specify additional parameters, source files, etc. Have you been able to do that?

straight-waiter-86090

02/14/2017, 3:14 PM

I’d like to have a

java_library

with some resources generated by transforming some source files. I’m not sure if the approach here will work for that case.

enough-sundown-78166

02/14/2017, 3:17 PM

We have exactly the same problem. We ended up using bash scripts as an interim solution, but I’d really love to have a way to to this entirely in pants

enough-sundown-78166

02/14/2017, 3:18 PM

We’ve got a resources file that needs to just have some string replacement done on it prior to inclusion in the final bundled zip

straight-waiter-86090

02/14/2017, 3:20 PM

yes, I’d like to have it done with pants because the generation of the files is slow. I’d like to use the cache system, etc. for this. (the files are css files run through the less compiler, jsx files run through babel, etc.)

high-advantage-47550

02/14/2017, 5:58 PM

is there a way to specify that “unused dependencies” should be an error/fatal?

full-kilobyte-93429

02/14/2017, 6:03 PM

@high-advantage-47550

Copy code

./pants help-advanced compile.zinc
...
--compile-zinc-unused-deps=<str> (one of: [ignore, warn, fatal] default: 'warn')
    Controls whether unused deps are checked, and whether they cause warnings or
    errors.

we turn this off at twitter because there could be false positives, tracked by https://github.com/pantsbuild/pants/issues/3669

high-advantage-47550

02/14/2017, 6:06 PM

ah! thank you

witty-crayon-22786

02/14/2017, 7:24 PM

@straight-waiter-86090 : does https://github.com/pantsbuild/pants/pull/4212 help with that?

straight-waiter-86090

02/14/2017, 7:28 PM

it sounds like this feature would create a .tar.gz of

node_modules

. In my case, I would want to depend on some node_modules, run some code in node using those modules, then archive/bundle the output created.

witty-crayon-22786

02/14/2017, 7:29 PM

if the setup is part of the

install

portion of the

node_modules

, i believe that it would run. cc @brash-cricket-7489

witty-crayon-22786

02/14/2017, 7:30 PM

but he's also working on a review to include the resulting files on the classpath of a jvm app, if that's what you're trying to do

straight-waiter-86090

02/14/2017, 7:31 PM

the

install

step would need to access source files as well, since the source files (.less files) are transformed into the output (.css).

straight-waiter-86090

02/14/2017, 7:32 PM

any way to bundle output from scripts/node/Java would be helpful I think. we have a mix of different cases like this. I can write a task to generate output, but I don’t know how to then bundle/zip/.tar.gz that output.

straight-waiter-86090

02/14/2017, 8:40 PM

Maybe my difficulty is trying to hook into jvm_app. Maybe I should make a different target and task that does the source transformation I want, then uses the archiving functionality to create a jar/zip/tgz. Then I could write a separate bundle task that copies this out into the dist directory. Then combine these files with my jvm_app outside of pants. are there example tasks that work like this?

witty-crayon-22786

02/14/2017, 8:42 PM

again, i think you're describing what @brash-cricket-7489 is currently working on.