Is remote execution considered stable? It looks li...
# general
c
Is remote execution considered stable? It looks like the CLI flags mark it as alpha
h
I’d say it mostly depends on what provider you use. Pants implements the open source Remote Execution API, so there are several different servers you can hook up to, or implement your own (non-trivial). Pants is the client. For Pants’s own CI, we were using Google’s RBE service for three months and it was awesome having 20 worker, compared to Travis’s 2 core CPU. But Google shut that down last month :/ There are some things that will need polish for Pants’s client-side, though, to be really ergonomic, e.g.: * better support for having different config for remote vs. local (Bazel’s “toolchains”) * speculation, meaning you can try local and remote, and go with what’s fastest For Toolchain’s remote execution/caching services we plan to offer, we’re focusing first on remote caching, and then will followup with remote execution.
f
I would add that Pants does not really support running the client on a different execution environment than the remote execution environment. For example, macOS client and Linux remote execution environment is an open issue.
👍 2
remote caching is the more tractable problem, and will likely be in 2.1.x
(I have it working locally on my laptop, PR to come this week)
as for remote execution, please feel free to ask any specifics in #C74CSTM32. We finally got Pants added to the remote-apis-testing framework so despite the caveats, Pants is compatible with Buildfarm, BuildBarn, and BuildGrid.
c
we're basically just looking to have the jobs execute on one of our physical servers
it should be entirely homogeneous
f
it should work for that use case. that is basically the narrow use case for which it does actually work currently.
c
nice, can you point me towards the software/docs to set that up?
f
I’ll have to write the Pants client docs for that. For server-side docs, depends on which server (Buildfarm, Buildbarn, Buildgrid) you want to choose.
buildbarn, for example, has example deployments at https://github.com/buildbarn/bb-deployments
buildgrid has example deployments at https://gitlab.com/BuildGrid/buildgrid-deployments
c
cool, that's exactly what I was looking for. Thanks!
f
I suggest joining buildteamworld.slack.com
there’s a channel for each of the major server projects
👍 1
I can send an invite if the auto-invite bot doesn’t work for you
c
yesh, doesn't seem to be working
f
DM me your email and I’ll send an invite
I think the auto-invite link is https://bit.ly/2SG1amT
got that off of the README of a buildbarn repo
but members of that Slack can send invites manually so that will work as well
c
I'm in 👍
👍 1
f
and let me know if you have any questions about the differences between the servers. I’ve basically setup all three in building the prototype of toolchain’s server offering
💯 1