Crate re_arrow_store

The Rerun datastore, implemented on top of Apache Arrow using the arrow2 crate.

This crate is an in-memory time series database for Rerun log data. It is indexed by Entity path, component, timeline, and time. It supports out-of-order insertions, and fast O(log(N)) queries.

• See DataStore for an overview of the core data structures.
• See DataStore::latest_at and DataStore::range for the documentation of the public read APIs.
• See DataStore::insert_row for the documentation of the public write APIs.

Feature flags

• testing — Enables access to re_types’ test components/datatypes.

• deadlock_detection — Enables parking_lot’s deadlock detection background thread.

• polars — Integration with polars, to efficiently use the datastore with dataframes.

• core_benchmarks_only — When set, only run the core set of benchmark suites. Commonly set implicitly by –all-features, e.g. on CI.

Re-exports

• pub use arrow2::io::ipc::read::StreamReader;
• pub use arrow2::io::ipc::read::StreamState;
• pub use re_log_types::TimeInt;
• pub use re_log_types::TimeRange;
• pub use re_log_types::TimeType;
• pub use re_log_types::Timeline;

Modules

• external
• polars_util

Structs

• DataStore
  A complete data store: covers all timelines, all entities, everything.
• DataStoreConfig
• DataStoreRowStats
• DataStoreStats
• EntityStats
• GarbageCollectionOptions
• LatestAtQuery
  A query at a given time, for a given timeline.
• RangeQuery
  A query over a time range, for a given timeline.
• StoreDiff
  Describes an atomic change in the Rerun DataStore: a row has been added or deleted.
• StoreEvent
  The atomic unit of change in the Rerun DataStore.
• StoreGeneration
  Incremented on each edit.
• StoreSubscriberHandle
• VersionedComponent
  A Component versioned with a specific RowId.

Enums

• GarbageCollectionTarget
• StoreDiffKind
  Is it an addition or a deletion?
• WriteError

Traits

• ArrayExt
• StoreSubscriber
  A StoreSubscriber subscribes to atomic changes from all DataStores through StoreEvents.

Type Aliases

• WriteResult