Struct CalibrationDataLoader 

pub struct CalibrationDataLoader { /* private fields */ }

Calibration data loader for pruning.

Provides an iterator over calibration batches for collecting activation statistics during pruning.

Implementations

impl CalibrationDataLoader

pub fn new(config: CalibrationDataConfig) -> Self

Create a new calibration data loader.

pub fn with_synthetic_data(config: CalibrationDataConfig) -> Self

Create a data loader with pre-loaded synthetic data for testing.

pub fn load(&mut self) -> Result<(), String>

Load data from the configured source.

This is a placeholder for actual dataset loading. In production, this would load from C4, WikiText, etc.

pub fn config(&self) -> &CalibrationDataConfig

Get the configuration.

pub fn is_loaded(&self) -> bool

Check if data is loaded.

pub fn num_batches(&self) -> usize

Get the number of batches.

pub fn reset(&mut self)

Reset the iterator position.

pub fn get_batch(&self, index: usize) -> Option<&Batch>

Get a batch by index.

pub fn iter(&self) -> CalibrationDataIter<'_>

Create an iterator over batches.

Trait Implementations

impl Clone for CalibrationDataLoader

fn clone(&self) -> CalibrationDataLoader

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CalibrationDataLoader

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> IntoIterator for &'a CalibrationDataLoader

type Item = &'a Batch

The type of the elements being iterated over.

type IntoIter = CalibrationDataIter<'a>

Which kind of iterator are we turning this into?

fn into_iter(self) -> Self::IntoIter

Creates an iterator from a value.