Struct TripletSampler 

pub struct TripletSampler<S: SplitStore + EpochStateStore + SamplerStateStore + 'static> { /* private fields */ }

Sampler that draws anchors from a single shared epoch cursor and then selects chunks from those records. Ingestion happens on demand when sampling.

Implementations

impl<S: SplitStore + EpochStateStore + SamplerStateStore + 'static> TripletSampler<S>

pub fn new(config: SamplerConfig, split_store: Arc<S>) -> Self

Create a sampler from config and a split-state backend.

pub fn new_with_chunker( config: SamplerConfig, split_store: Arc<S>, chunker: Arc<dyn ChunkingAlgorithm>, ) -> Self

Create a sampler from config with a custom chunking implementation.

pub fn next_pair_batch_for_split( &self, split: SplitLabel, ) -> Result<SampleBatch, SamplerError>

👎Deprecated:

samples all sources uniformly; call next_pair_batch_with_weights_for_split(split, &weights) with an explicit per-source weight map to honor a data mixture

Return an unweighted pair batch for split.

Samples all sources uniformly. Prefer Self::next_pair_batch_with_weights_for_split with an explicit per-source weight map to honor a data mixture.

pub fn next_text_batch_for_split( &self, split: SplitLabel, ) -> Result<TextBatch, SamplerError>

👎Deprecated:

samples all sources uniformly; call next_text_batch_with_weights_for_split(split, &weights) with an explicit per-source weight map to honor a data mixture

Return an unweighted text batch for split.

Samples all sources uniformly. Prefer Self::next_text_batch_with_weights_for_split with an explicit per-source weight map to honor a data mixture.

pub fn next_triplet_batch_for_split( &self, split: SplitLabel, ) -> Result<TripletBatch, SamplerError>

👎Deprecated:

samples all sources uniformly; call next_triplet_batch_with_weights_for_split(split, &weights) with an explicit per-source weight map to honor a data mixture

Return an unweighted triplet batch for split.

Samples all sources uniformly. Prefer Self::next_triplet_batch_with_weights_for_split with an explicit per-source weight map to honor a data mixture.

pub fn next_pair_batch_with_weights_for_split( &self, split: SplitLabel, weights: &HashMap<SourceId, f32>, ) -> Result<SampleBatch, SamplerError>

Return a weighted pair batch for split using per-source weights.

Source choice is deficit round-robin over the map: deterministic and exact over each weight cycle (0.75/0.25 yields exactly 3:1 anchors). Unlisted sources get quantum 1.0; non-finite/negative quanta count as 0. Empty or all-equal maps keep legacy uniform cycling bit-identically. Weights also steer ingestion; see ingest_with_weights_fallback.

pub fn next_text_batch_with_weights_for_split( &self, split: SplitLabel, weights: &HashMap<SourceId, f32>, ) -> Result<TextBatch, SamplerError>

Return a weighted text batch for split using per-source weights.

Source choice is deficit round-robin over the map: deterministic and exact over each weight cycle. Unlisted sources get quantum 1.0; non-finite/negative quanta count as 0. Empty or all-equal maps keep legacy uniform cycling bit-identically.

pub fn next_triplet_batch_with_weights_for_split( &self, split: SplitLabel, weights: &HashMap<SourceId, f32>, ) -> Result<TripletBatch, SamplerError>

Return a weighted triplet batch for split using per-source weights.

Source choice is deficit round-robin over the map: deterministic and exact over each weight cycle. Unlisted sources get quantum 1.0; non-finite/negative quanta count as 0. Empty or all-equal maps keep legacy uniform cycling bit-identically.

pub fn prefetch_triplet_batches( self: Arc<Self>, split: SplitLabel, capacity: usize, ) -> BatchPrefetcher<TripletBatch>

👎Deprecated:

samples all sources uniformly; call prefetch_triplet_batches_with_weights(split, capacity, weights) with an explicit per-source weight map to honor a data mixture

Spawn a background prefetcher for triplet batches.

Samples all sources uniformly. Prefer Self::prefetch_triplet_batches_with_weights with an explicit per-source weight map to honor a data mixture.

pub fn prefetch_triplet_batches_with_weights( self: Arc<Self>, split: SplitLabel, capacity: usize, weights: HashMap<SourceId, f32>, ) -> BatchPrefetcher<TripletBatch>

Spawn a background prefetcher for weighted triplet batches.

pub fn prefetch_pair_batches( self: Arc<Self>, split: SplitLabel, capacity: usize, ) -> BatchPrefetcher<SampleBatch>

👎Deprecated:

samples all sources uniformly; call prefetch_pair_batches_with_weights(split, capacity, weights) with an explicit per-source weight map to honor a data mixture

Spawn a background prefetcher for pair batches.

Samples all sources uniformly. Prefer Self::prefetch_pair_batches_with_weights with an explicit per-source weight map to honor a data mixture.

pub fn prefetch_pair_batches_with_weights( self: Arc<Self>, split: SplitLabel, capacity: usize, weights: HashMap<SourceId, f32>, ) -> BatchPrefetcher<SampleBatch>

Spawn a background prefetcher for weighted pair batches.

pub fn prefetch_text_batches( self: Arc<Self>, split: SplitLabel, capacity: usize, ) -> BatchPrefetcher<TextBatch>

👎Deprecated:

samples all sources uniformly; call prefetch_text_batches_with_weights(split, capacity, weights) with an explicit per-source weight map to honor a data mixture

Spawn a background prefetcher for text batches.

Samples all sources uniformly. Prefer Self::prefetch_text_batches_with_weights with an explicit per-source weight map to honor a data mixture.

pub fn prefetch_text_batches_with_weights( self: Arc<Self>, split: SplitLabel, capacity: usize, weights: HashMap<SourceId, f32>, ) -> BatchPrefetcher<TextBatch>

Spawn a background prefetcher for weighted text batches.

pub fn text_recipes(&self) -> Vec<TextRecipe>

Return the currently active text recipes.

pub fn register_source( &self, source: Box<dyn DataSource + 'static>, ) -> Result<(), SamplerError>

Register a data source for ingestion and sampling.

Returns an error if the source’s id() matches the reserved __*__ pattern used for internal synthetic/metadata source identifiers.

pub fn set_epoch(&self, epoch: u64) -> Result<(), SamplerError>

Force sampler epoch to epoch (advanced deterministic replay control).

pub fn save_sampler_state( &self, save_to: Option<&Path>, ) -> Result<(), SamplerError>

Persist sampler and split runtime state for restart-resume.

When save_to is Some(path), current persisted runtime state is also mirrored to path when supported by the split-store backend.

Trait Implementations

impl<S: SplitStore + EpochStateStore + SamplerStateStore + 'static> Sampler for TripletSampler<S>

fn next_pair_batch( &self, split: SplitLabel, ) -> Result<SampleBatch, SamplerError>

👎Deprecated:

samples all sources uniformly; call next_pair_batch_with_weights(split, &weights) with an explicit per-source weight map to honor a data mixture

Returns a batch of pairs. Consumes the shared epoch cursor for anchor selection.

fn next_pair_batch_with_weights( &self, split: SplitLabel, weights: &HashMap<SourceId, f32>, ) -> Result<SampleBatch, SamplerError>

Returns a batch of pairs with per-call source weights.

fn next_text_batch(&self, split: SplitLabel) -> Result<TextBatch, SamplerError>

👎Deprecated:

samples all sources uniformly; call next_text_batch_with_weights(split, &weights) with an explicit per-source weight map to honor a data mixture

Returns a batch of text samples. Consumes the shared epoch cursor for anchor selection.

fn next_text_batch_with_weights( &self, split: SplitLabel, weights: &HashMap<SourceId, f32>, ) -> Result<TextBatch, SamplerError>

Returns a batch of text samples with per-call source weights.

fn next_triplet_batch( &self, split: SplitLabel, ) -> Result<TripletBatch, SamplerError>

👎Deprecated:

samples all sources uniformly; call next_triplet_batch_with_weights(split, &weights) with an explicit per-source weight map to honor a data mixture

Returns a batch of triplets. Consumes the shared epoch cursor for anchor selection.

fn next_triplet_batch_with_weights( &self, split: SplitLabel, weights: &HashMap<SourceId, f32>, ) -> Result<TripletBatch, SamplerError>

Returns a batch of triplets with per-call source weights.

fn save_sampler_state(&self, save_to: Option<&Path>) -> Result<(), SamplerError>

Persist sampler and split runtime state for restart-resume.