#19902 Refactoring of remote stores after initial addition of OpenDAL
Issue created by
huonw
With
#19827, there's a bunch of refactoring of the remote stores:
☐ improving the docs and help strings
☑︎ moving the providers to be in their own crate(s), to be able to have a single source of truth for configuration and easier testing too (
#19827 (comment)):
#19958
☐ tweaking the internal Rust details of how the remote providers are built to have less duplication
☐ various details about how we use OpenDAL
☐ improving how the options are fed through
#19827 (comment)
☐ doing the
grpc://
->
http://
(and
s
version) mapping within the REAPI provider, as an implementation detail (
#19887 (comment))
☐ probably: add a
remote_store_provider = "..."
option rather than trying to shove it into
remote_store_address
via the schema (with a default to "reapi" or something)
☐ probably: a
remote_oauth_bearer_token
option to allow setting the token directly via an env var
pantsbuild/pants