Struct QualitySourceContext 

pub struct QualitySourceContext {
    pub file_names: Vec<String>,
    pub file_starts: Vec<usize>,
    pub row_index_column: String,
    pub file_group: Vec<u32>,
    pub drift_groups: Arc<Vec<DriftGroup>>,
    pub file_omitted: Vec<Vec<(PlSmallStr, DataType)>>,
    pub dataset_rows: usize,
    pub footers_read: usize,
    pub conflict_scan: Option<QualityConflictScan>,
}

Fields

file_names: Vec<String>

file_starts: Vec<usize>

row_index_column: String

file_group: Vec<u32>

Per file, in the order of file_names, its group in drift_groups. Empty when the dataset’s files all agree with its schema, which is nearly all of them.

drift_groups: Arc<Vec<DriftGroup>>

The distinct ways this dataset’s files differ from its schema, as the footers found them. Group 0 is always “nothing missing”.

file_omitted: Vec<Vec<(PlSmallStr, DataType)>>

Per file, the type it holds each of its unreadable columns in. Empty for a file whose types all fit, which is why it is kept beside the groups rather than in them: the type is the only way back to the values a conflict hides.

dataset_rows: usize

Rows in the whole loaded source, which is what closes the last file’s range.

footers_read: usize

How many of the source’s footers were read. Below the file count on a dataset too large to read every footer, where a file nobody looked at is indistinguishable from one missing nothing — so a count over the files is a floor, not a total.

conflict_scan: Option<QualityConflictScan>

How to read a column at the type a file wrote it in, for the values a type conflict hides. None for a dataset whose files agree, and for a run whose budget did not promise the extra reads.

Trait Implementations

impl Clone for QualitySourceContext

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QualitySourceContext

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for QualitySourceContext

fn default() -> Self

Returns the “default value” for a type.