Struct RecordSource 

pub struct RecordSource { /* private fields */ }

Adapts any DatasetReader into a Source the generic engine can collect.

Implementations

impl RecordSource

pub fn new(name: impl Into<String>, reader: Box<dyn DatasetReader>) -> Self

Create a record source with a stable name over the given reader.

pub fn with_cache_key(self, cache_key: Value) -> Self

Override the cache key describing this source’s configured inputs.

pub fn with_max_items(self, max_items: usize) -> Self

Declare the maximum number of records this source will emit.

Trait Implementations

impl Source<DatasetRecord> for RecordSource

fn name(&self) -> &str

Stable source identifier used in manifests.

fn stream( self: Box<Self>, _cancel: CancellationToken, ) -> BoxItemStream<DatasetRecord>

Stream items from this source.

fn cache_key(&self) -> Value

Stable cache key describing this source’s configured inputs.

fn max_items(&self) -> Option<usize>

Optional maximum number of items this source will emit.

fn display_name(&self) -> &str

Human-readable source label.

fn set_resume_state(&mut self, _offset: usize, _already_fetched: usize)

Configure resume state before streaming.