Skip to main content

Module profile_builder

Module profile_builder 

Source
Expand description

Shared conversion from StreamingColumnCollection / StreamingStatistics into ColumnProfile and quality-check sample maps.

All engines that need to produce a ColumnProfile should call build_column_profile instead of constructing one manually. This ensures consistent stats calculation and pattern detection.

Structs§

ColumnProfileInput
Inputs that every engine can provide for centralized profile construction.
TextLengths
Pre-computed text length stats from streaming/columnar engines.

Functions§

build_column_profile
Build a ColumnProfile from engine-agnostic inputs.
infer_data_type_streaming
Infer DataType from StreamingStatistics sample values.
profile_from_stats
Convert a single column’s StreamingStatistics into a ColumnProfile.
profile_from_stats_with_hints
Convert a single column into a ColumnProfile while applying semantic hints.
profiles_from_streaming
Convert all columns in a StreamingColumnCollection into ColumnProfiles.
profiles_from_streaming_with_hints
Convert all columns into ColumnProfiles while applying semantic hints.
quality_check_samples
Build a sample HashMap from a StreamingColumnCollection suitable for QualityMetrics::calculate_from_data().