Well, possibly what we want for CI is to build a docker image with everything warmed up (engine, jvm tools, binary utils, npm and whatever else) and then run tests on that image?