Expand description
Object-store adapter for the Quarb query engine: Google Cloud Storage and Amazon S3 buckets as lazy directory trees.
Object keys with / separators span the tree the way a
filesystem does — the adapter lists one “directory” per touch
(delimiter listing, paginated), and an object’s content is its
value, fetched on first read and cached. Under composition
(qua wraps object stores by default), a bucket of JSON, CSV,
or source files is directly queryable: the object is a leaf,
its parsed content the subtree — grafting is the point of this
adapter.
Targets:
gs://BUCKET[/PREFIX]— GCS, JSON API. Public buckets work anonymously; private ones authenticate like the other GCP drivers (QUARB_GCP_TOKEN, elsegcloud auth print-access-token,?account=EMAILto pick the account — set?auth=1to force a token for non-public buckets).s3://BUCKET[/PREFIX][?region=R]— S3, ListObjectsV2. Anonymous only in v1: public buckets read without credentials; SigV4 request signing is a recorded extension, so private S3 buckets refuse honestly rather than half-work.
Metadata: ;;;size, ;;;updated on objects; traits
<object> / <prefix>. Read-only, as always.
Structs§
- Objstore
Adapter - A bucket (or prefix of one), exposed as an arbor.
Enums§
- Objstore
Error - An error connecting to a bucket.