Skip to main content

Crate quarb_objstore

Crate quarb_objstore 

Source
Expand description

Object-store adapter for the Quarb query engine: Google Cloud Storage and Amazon S3 buckets as lazy directory trees.

Object keys with / separators span the tree the way a filesystem does — the adapter lists one “directory” per touch (delimiter listing, paginated), and an object’s content is its value, fetched on first read and cached. Under composition (qua wraps object stores by default), a bucket of JSON, CSV, or source files is directly queryable: the object is a leaf, its parsed content the subtree — grafting is the point of this adapter.

Targets:

  • gs://BUCKET[/PREFIX] — GCS, JSON API. Public buckets work anonymously; private ones authenticate like the other GCP drivers (QUARB_GCP_TOKEN, else gcloud auth print-access-token, ?account=EMAIL to pick the account — set ?auth=1 to force a token for non-public buckets).
  • s3://BUCKET[/PREFIX][?region=R] — S3, ListObjectsV2. Anonymous only in v1: public buckets read without credentials; SigV4 request signing is a recorded extension, so private S3 buckets refuse honestly rather than half-work.

Metadata: ::;size, ::;updated on objects; traits <object> / <prefix>. Read-only, as always.

Structs§

ObjstoreAdapter
A bucket (or prefix of one), exposed as an arbor.

Enums§

ObjstoreError
An error connecting to a bucket.