Expand description
Analysis of the view: the sample every tool reads, statistics, distributions, value counts and Data Quality.
Modules§
- analysis_
modal - data_
quality - distribution_
fit - Fitting a column to each candidate distribution and testing each fit. One parameter set per family, estimated once, serves the test, Q-Q plot and histogram overlay. The test is Kolmogorov-Smirnov calibrated by parametric bootstrap (the statistic ranked among those of samples drawn from the fit and refitted), so it is a valid p-value with estimated parameters and for discrete families. A p-value is not the probability of the model, and the largest is not the best: among unrejected families, the lowest AIC wins.
- intent_
modal - The form Data Quality Setup opens on one column to declare what it must hold: part of the key, required, read as a number, an allowed set, a range. It stages into Setup’s draft, which only Run reads with.
- quality_
export - A Data Quality report written to a file: the measurements on screen, the setup they were measured with, and the source they were measured on. Built from the results in memory; writing one reads nothing from the data.
- quality_
intent - Declared column intent for Data Quality: what a column must hold, said by the user, measured on the rows a run reads anyway.
- quality_
report - Data Quality results as a report: what is likely wrong, what depends on intent, and
which columns have nothing to report. Each check kind is one row of
ObservationKind::spec(names, severity, rank, advice, grouping, wording). Built once per result; the engine, cache and drill-in work on observations, which a finding only groups and ranks. - quality_
trends - Trends and gaps: a report’s segments in order, pooled into the bars a terminal has room for, and the time windows a study said to expect checked against the segments a run counted. Built from the measurements a run kept: nothing here reads.
- sample_
modal - The Sample form: the one place an analysis’s rows are chosen, for every tool.
It edits a copy of the shared
Sample; Enter applies it, Esc discards it. - sampling
- The one sampler every analysis tool reads through: which rows (a scope), how they
are picked (a method), how many, and the seed. Describe, Distribution, Correlation
and Data Quality all take their rows from
read, so a sample means the same thing whichever tool shows it. - statistics
- table_
sample - The sample as a step of the view: drawn into memory a chunk at a time, while the table shows the rows kept so far.
- value_
counts - Value counts: how many rows of the view hold each value of one column, and a summary of the column, from one read of that column.
- value_
counts_ modal - State of the Value Counts screen: which column, the counts read for the view, the order, the cursor, and the count in flight.