Skip to main content

Module source

Module source 

Source
Expand description

Data source traits and built-in sources. Data source interfaces and paging helpers.

Ownership model:

  • DataSource is the sampler-facing interface that produces batches.
  • IndexableSource exposes stable, index-based access into a corpus.
  • IndexablePager owns the deterministic pseudo-random paging logic and can page any indexable source without retaining per-record state.

Re-exports§

pub use backends::csv_source::CsvSource;
pub use backends::csv_source::CsvSourceConfig;
pub use backends::file_source::FileSource;
pub use backends::file_source::FileSourceConfig;
pub use backends::file_source::SectionBuilder;
pub use backends::file_source::TaxonomyBuilder;
pub use backends::file_source::anchor_context_sections;
pub use backends::file_source::taxonomy_from_path;
pub use backends::in_memory_source::InMemorySource;

Modules§

backends
Source implementation modules.
indexing
Utility helpers used by source implementations.

Structs§

IndexPermutation
Internal permutation used by IndexablePager.
IndexableAdapter
DataSource adapter that pages an IndexableSource via IndexablePager.
IndexablePager
Deterministic pager for IndexableSource.
SourceCursor
Source-owned incremental refresh position.
SourceSnapshot
Result of a single source refresh call.

Traits§

DataSource
Sampler-facing data source interface.
IndexableSource
Index-addressable source interface used by deterministic pagers.