I went ahead and tried the docker option in https://github.com/buchgr/bazel-remote it works extremely well, reduced our builds by an order of magnitude.