Skip to main content

Module profile_builder

Module profile_builder 

Source
Expand description

Shared conversion from StreamingColumnCollection / StreamingStatistics into ColumnProfile and quality-check sample maps.

All engines that need to produce a ColumnProfile should call build_column_profile instead of constructing one manually. This ensures consistent stats calculation and pattern detection.

Structs§

ColumnProfileInput
Inputs that every engine can provide for centralized profile construction.
ExactNumericAggregates
Exact streaming aggregates for a numeric column: O(1)-memory statistics that an engine computed over the entire stream, as opposed to the bounded sample_values it retained.
TextLengths
Pre-computed text length stats from streaming/columnar engines.

Functions§

build_column_profile
Build a ColumnProfile from engine-agnostic inputs.
infer_data_type_streaming
Infer DataType from StreamingStatistics sample values.
profile_from_stats
Convert a single column’s StreamingStatistics into a ColumnProfile.
profile_from_stats_with_hints
Convert a single column into a ColumnProfile while applying semantic hints.
profiles_from_streaming
Convert all columns in a StreamingColumnCollection into ColumnProfiles.
profiles_from_streaming_with_hints
Convert all columns into ColumnProfiles while applying semantic hints.
quality_check_samples
Build a sample HashMap from a StreamingColumnCollection suitable for QualityMetrics::calculate_from_data().