Expand description
§String Operations Kernels Module - High-Performance String Processing and Text Analysis
String processing kernels for text manipulation, pattern matching, and string analysis operations with UTF-8 awareness and null-safe semantics. Essential infrastructure for text analytics, data cleansing, and string-heavy analytical workloads.
§Core Operations
- String transformations: Case conversion, trimming, padding, and substring operations
- Pattern matching: Regular expression support with compiled pattern caching
- String comparison: Lexicographic ordering with UTF-8 aware collation
- Text analysis: Length calculation, character counting, and encoding detection
- String aggregation: Concatenation with configurable delimiters and null handling
- Search operations: Contains, starts with, ends with predicates with optimised implementations
Enums§
- PadSide
- Side for string padding operations.
Functions§
- byte_
length_ dict - Computes the byte length of each string in a CategoricalArray slice.
- byte_
length_ str - Computes the byte length of each string in a StringArray slice.
- concat_
dict_ dict - Concatenates corresponding string pairs from two categorical arrays element-wise.
- concat_
dict_ str - Concatenates dictionary values from a categorical array with strings from a string array.
- concat_
str_ dict - Concatenates strings from a string array with dictionary values from a categorical array.
- concat_
str_ str - Concatenates corresponding string pairs from two string arrays element-wise.
- contains_
dict_ dict - Performs string predicate operations between two categorical arrays.
- contains_
dict_ str - Performs string predicate operations between categorical and string arrays.
- contains_
str_ dict - Performs string predicate operations between string and categorical arrays.
- contains_
str_ str - Performs string predicate operations between two string arrays.
- count_
distinct_ string - Counts the number of distinct string values in a string array window.
- count_
match_ dict - Counts non-overlapping occurrences of
needlein each categorical string element. - count_
match_ str - Counts non-overlapping occurrences of
needlein each string element. - ends_
with_ dict_ dict - Performs string predicate operations between two categorical arrays.
- ends_
with_ dict_ str - Performs string predicate operations between categorical and string arrays.
- ends_
with_ str_ dict - Performs string predicate operations between string and categorical arrays.
- ends_
with_ str_ str - Performs string predicate operations between two string arrays.
- find_
dict - Finds the first byte index of
needlein each categorical string element. Returns -1 if not found. - find_
str - Finds the first byte index of
needlein each string element. Returns -1 if not found. - join_
dict - Joins all non-null categorical string elements with
delimiter, returning a single string. ReturnsNoneif all elements are null. - join_
str - Joins all non-null string elements with
delimiter, returning a single string. ReturnsNoneif all elements are null. - len_
dict - Computes the character length of each string in a
CategoricalArray<T>slice, returning anIntegerArray<T>with the same length and null semantics. - len_str
- Computes the character length of each string in a
StringArray<T>slice, returning anIntegerArray<T>with the same length and null semantics. - ltrim_
dict - Trims leading whitespace from each categorical string element.
- ltrim_
str - Trims leading whitespace from each string element.
- max_
categorical_ array - Finds the lexicographically maximum dictionary string in a categorical array window.
- max_
string_ array - Finds the lexicographically maximum string in a string array window.
- min_
categorical_ array - Finds the lexicographically minimum dictionary string in a categorical array window.
- min_
string_ array - Finds the lexicographically minimum string in a string array window.
- pad_
dict - Pads each categorical string element to
widthcharacters usingfill_char. - pad_str
- Pads each string element to
widthcharacters usingfill_char. - repeat_
dict - Repeats each categorical string element
ntimes. - repeat_
str - Repeats each string element
ntimes. - replace_
dict - Replaces all occurrences of
fromwithtoin each categorical string element. - replace_
str - Replaces all occurrences of
fromwithtoin each string element. - reverse_
dict - Reverses each categorical string element by Unicode characters.
- reverse_
str - Reverses each string element by Unicode characters.
- rtrim_
dict - Trims trailing whitespace from each categorical string element.
- rtrim_
str - Trims trailing whitespace from each string element.
- starts_
with_ dict_ dict - Performs string predicate operations between two categorical arrays.
- starts_
with_ dict_ str - Performs string predicate operations between categorical and string arrays.
- starts_
with_ str_ dict - Performs string predicate operations between string and categorical arrays.
- starts_
with_ str_ str - Performs string predicate operations between two string arrays.
- substring_
dict - Extracts a character-based substring from each categorical string element.
- substring_
str - Extracts a character-based substring from each string element.
startis the 0-based character offset.opt_lenlimits the number of characters taken. - to_
lowercase_ dict - Converts each categorical string element to lowercase.
- to_
lowercase_ str - Converts each string element to lowercase.
- to_
uppercase_ dict - Converts each categorical string element to uppercase.
- to_
uppercase_ str - Converts each string element to uppercase.
- trim_
dict - Trims leading and trailing whitespace from each categorical string element.
- trim_
str - Trims leading and trailing whitespace from each string element.