Expand description
Data source traits and built-in sources. Data source interfaces and paging helpers.
Ownership model:
DataSourceis the sampler-facing interface that produces batches.IndexableSourceexposes stable, index-based access into a corpus.IndexablePagerowns the deterministic pseudo-random paging logic and can page any indexable source without retaining per-record state.
Re-exports§
pub use backends::csv_source::CsvSource;pub use backends::csv_source::CsvSourceConfig;pub use backends::file_source::FileSource;pub use backends::file_source::FileSourceConfig;pub use backends::file_source::SectionBuilder;pub use backends::file_source::TaxonomyBuilder;pub use backends::file_source::anchor_context_sections;pub use backends::file_source::taxonomy_from_path;pub use backends::in_memory_source::InMemorySource;
Modules§
Structs§
- Index
Permutation - Internal permutation used by
IndexablePager. - Indexable
Adapter - DataSource adapter that pages an
IndexableSourceviaIndexablePager. - Indexable
Pager - Deterministic pager for
IndexableSource. - Source
Cursor - Source-owned incremental refresh position.
- Source
Snapshot - Result of a single source refresh call.
Traits§
- Data
Source - Sampler-facing data source interface.
- Indexable
Source - Index-addressable source interface used by deterministic pagers.