Skip to main content

QueryRows

Struct QueryRows 

Source
pub struct QueryRows { /* private fields */ }
Expand description

A lazy, resumable cursor over the quads of an open .rete — the engine side of for await (const [s, p, o, g] of graph.dump()) in the JS client.

§Why a cursor and not a callback

Rete::dump_each already streams in constant memory, but a Rust callback cannot be paused to hand control back to JavaScript: to feed a JS iterator it would have to buffer every quad first, which is exactly the Vec that Rete::dump builds and that OOMs on a large file. This wraps Rete::query_batch instead, so the scan can be suspended between calls and resumed in place — the whole resume state is one opaque u64, never a whole-graph materialization anywhere in the pipeline.

§Why batched (and not one call per quad)

Each wasm→JS call costs far more than decoding a triple, and every returned String becomes a fresh JS string. Pulling one quad per call would make the boundary the bottleneck; pulling all of them would reintroduce the Vec. So the JS wrapper asks for DUMP_BATCH quads at a time and yields them one by one — bounded, amortized, and lazy. Memory is O(batch), not O(graph).

§Cost model

The dictionary is not prefetched whole: each batch faults only the chunks its own terms live in, so taking five quads off the front costs five quads’ worth of dictionary rather than all of it. Index tiles fault in as the scan advances and stay resident, and so do dictionary chunks, so an unfiltered dump driven to the end still ends up fetching essentially the whole file — that is inherent in exporting a graph.

A filtered cursor (a bound s / p / o) is a different shape: the scan routes to the one permutation that sorts on the bound prefix and drops every tile whose synopsis proves it cannot match, from the tile directory, without fetching it. On cordis.rete (801 MB, six named graphs) dumping one predicate of one graph reads 16 MB where the unfiltered dump of that graph reads 376 MB. Peak memory is O(faulted dictionary + index), never O(quads), either way. A SELECT answered to dictionary ids: the result handle of Graph::query_rows and RemoteGraph::query_rows.

query evaluates a SELECT and decodes every term of every row to JSON; a page of 25 rows of a 650,000-row result still costs the whole result’s dictionary chunks (181 MB for a class of the nanopub dump). The handle keeps the rows as ids, with the exact row count, and page(offset, limit) decodes one window, as one batch of chunk reads. What the query itself needs is decoded as before (the keys of an ORDER BY, the inputs of a FILTER); the other columns wait for the page. free() it when done.

Implementations§

Source§

impl QueryRows

Source

pub fn vars(&self) -> String

The projected variables, a JSON array (for SELECT *, the variables some row binds, in name order).

Source

pub fn len(&self) -> f64

The exact number of rows.

Source

pub fn page(&self, offset: usize, limit: usize) -> Result<String, JsValue>

Rows offset..offset + limit (cut at the end), in the envelope of query(..., "json"): {"kind":"select","vars":[…],"rows":[{var:term}]} plus "offset" and "total". Calling it again, or for another window, reuses the dictionary chunks already read.

Trait Implementations§

Source§

impl From<QueryRows> for JsValue

Source§

fn from(value: QueryRows) -> Self

Converts to this type from the input type.
Source§

impl FromWasmAbi for QueryRows

Source§

type Abi = WasmPtr<WasmRefCell<QueryRows>>

The Wasm ABI type that this converts from when coming back out from the ABI boundary.
Source§

unsafe fn from_abi(js: Self::Abi) -> Self

Recover a Self from Self::Abi. Read more
Source§

impl IntoWasmAbi for QueryRows

Source§

type Abi = WasmPtr<WasmRefCell<QueryRows>>

The Wasm ABI type that this converts into when crossing the ABI boundary.
Source§

fn into_abi(self) -> Self::Abi

Convert self into Self::Abi so that it can be sent across the wasm ABI boundary.
Source§

impl LongRefFromWasmAbi for QueryRows

Source§

type Abi = WasmPtr<WasmRefCell<QueryRows>>

Same as RefFromWasmAbi::Abi
Source§

type Anchor = RcRef<QueryRows>

Same as RefFromWasmAbi::Anchor
Source§

unsafe fn long_ref_from_abi(js: Self::Abi) -> Self::Anchor

Same as RefFromWasmAbi::ref_from_abi
Source§

impl OptionFromWasmAbi for QueryRows

Source§

fn is_none(abi: &Self::Abi) -> bool

Tests whether the argument is a “none” instance. If so it will be deserialized as None, and otherwise it will be passed to FromWasmAbi.
Source§

impl OptionIntoWasmAbi for QueryRows

Source§

fn none() -> Self::Abi

Returns an ABI instance indicating “none”, which JS will interpret as the None branch of this option. Read more
Source§

impl RefFromWasmAbi for QueryRows

Source§

type Abi = WasmPtr<WasmRefCell<QueryRows>>

The Wasm ABI type references to Self are recovered from.
Source§

type Anchor = RcRef<QueryRows>

The type that holds the reference to Self for the duration of the invocation of the function that has an &Self parameter. This is required to ensure that the lifetimes don’t persist beyond one function call, and so that they remain anonymous.
Source§

unsafe fn ref_from_abi(js: Self::Abi) -> Self::Anchor

Recover a Self::Anchor from Self::Abi. Read more
Source§

impl RefMutFromWasmAbi for QueryRows

Source§

type Abi = WasmPtr<WasmRefCell<QueryRows>>

Same as RefFromWasmAbi::Abi
Source§

type Anchor = RcRefMut<QueryRows>

Same as RefFromWasmAbi::Anchor
Source§

unsafe fn ref_mut_from_abi(js: Self::Abi) -> Self::Anchor

Same as RefFromWasmAbi::ref_from_abi
Source§

impl SupportsConstructor for QueryRows

Source§

impl SupportsInstanceProperty for QueryRows

Source§

impl SupportsStaticProperty for QueryRows

Source§

impl TryFromJsValue for QueryRows

Source§

fn try_from_js_value(value: JsValue) -> Result<Self, JsValue>

Performs the conversion.
Source§

fn try_from_js_value_ref(value: &JsValue) -> Option<Self>

Performs the conversion.
Source§

impl VectorFromWasmAbi for QueryRows

Source§

type Abi = <Box<[JsValue]> as FromWasmAbi>::Abi

Source§

unsafe fn vector_from_abi(js: Self::Abi) -> Box<[QueryRows]>

Source§

impl VectorIntoWasmAbi for QueryRows

Source§

impl WasmDescribe for QueryRows

Source§

impl WasmDescribeVector for QueryRows

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> ReturnWasmAbi for T
where T: IntoWasmAbi,

Source§

type Abi = <T as IntoWasmAbi>::Abi

Same as IntoWasmAbi::Abi
Source§

fn return_abi(self) -> <T as ReturnWasmAbi>::Abi

Same as IntoWasmAbi::into_abi, except that it may throw and never return in the case of Err.
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<S, T> Upcast<T> for S
where T: UpcastFrom<S> + ?Sized, S: ?Sized,

Source§

fn upcast(&self) -> &T
where Self: ErasableGeneric, T: Sized + ErasableGeneric<Repr = Self::Repr>,

Perform a zero-cost type-safe upcast to a wider ref type within the Wasm bindgen generics type system. Read more
Source§

fn upcast_into(self) -> T
where Self: Sized + ErasableGeneric, T: Sized + ErasableGeneric<Repr = Self::Repr>,

Perform a zero-cost type-safe upcast to a wider type within the Wasm bindgen generics type system. Read more
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V