Skip to main content

Module analysis

Module analysis 

Source
Expand description

Analysis of the view: the sample every tool reads, statistics, distributions, value counts and Data Quality.

Modules§

analysis_modal
data_quality
distribution_fit
Fitting a column to each candidate distribution and testing each fit. One parameter set per family, estimated once, serves the test, Q-Q plot and histogram overlay. The test is Kolmogorov-Smirnov calibrated by parametric bootstrap (the statistic ranked among those of samples drawn from the fit and refitted), so it is a valid p-value with estimated parameters and for discrete families. A p-value is not the probability of the model, and the largest is not the best: among unrejected families, the lowest AIC wins.
intent_modal
The form Data Quality Setup opens on one column to declare what it must hold: part of the key, required, read as a number, an allowed set, a range. It stages into Setup’s draft, which only Run reads with.
quality_export
A Data Quality report written to a file: the measurements on screen, the setup they were measured with, and the source they were measured on. Built from the results in memory; writing one reads nothing from the data.
quality_intent
Declared column intent for Data Quality: what a column must hold, said by the user, measured on the rows a run reads anyway.
quality_report
Data Quality results as a report: what is likely wrong, what depends on intent, and which columns have nothing to report. Each check kind is one row of ObservationKind::spec (names, severity, rank, advice, grouping, wording). Built once per result; the engine, cache and drill-in work on observations, which a finding only groups and ranks.
quality_trends
Trends and gaps: a report’s segments in order, pooled into the bars a terminal has room for, and the time windows a study said to expect checked against the segments a run counted. Built from the measurements a run kept: nothing here reads.
sample_modal
The Sample form: the one place an analysis’s rows are chosen, for every tool. It edits a copy of the shared Sample; Enter applies it, Esc discards it.
sampling
The one sampler every analysis tool reads through: which rows (a scope), how they are picked (a method), how many, and the seed. Describe, Distribution, Correlation and Data Quality all take their rows from read, so a sample means the same thing whichever tool shows it.
statistics
table_sample
The sample as a step of the view: drawn into memory a chunk at a time, while the table shows the rows kept so far.
value_counts
Value counts: how many rows of the view hold each value of one column, and a summary of the column, from one read of that column.
value_counts_modal
State of the Value Counts screen: which column, the counts read for the view, the order, the cursor, and the count in flight.