Skip to main content

Module string

Module string 

Source
Expand description

§String Operations Kernels Module - High-Performance String Processing and Text Analysis

String processing kernels for text manipulation, pattern matching, and string analysis operations with UTF-8 awareness and null-safe semantics. Essential infrastructure for text analytics, data cleansing, and string-heavy analytical workloads.

§Core Operations

  • String transformations: Case conversion, trimming, padding, and substring operations
  • Pattern matching: Regular expression support with compiled pattern caching
  • String comparison: Lexicographic ordering with UTF-8 aware collation
  • Text analysis: Length calculation, character counting, and encoding detection
  • String aggregation: Concatenation with configurable delimiters and null handling
  • Search operations: Contains, starts with, ends with predicates with optimised implementations

Enums§

PadSide
Side for string padding operations.

Functions§

byte_length_dict
Computes the byte length of each string in a CategoricalArray slice.
byte_length_str
Computes the byte length of each string in a StringArray slice.
concat_dict_dict
Concatenates corresponding string pairs from two categorical arrays element-wise.
concat_dict_str
Concatenates dictionary values from a categorical array with strings from a string array.
concat_str_dict
Concatenates strings from a string array with dictionary values from a categorical array.
concat_str_str
Concatenates corresponding string pairs from two string arrays element-wise.
contains_dict_dict
Performs string predicate operations between two categorical arrays.
contains_dict_str
Performs string predicate operations between categorical and string arrays.
contains_str_dict
Performs string predicate operations between string and categorical arrays.
contains_str_str
Performs string predicate operations between two string arrays.
count_distinct_string
Counts the number of distinct string values in a string array window.
count_match_dict
Counts non-overlapping occurrences of needle in each categorical string element.
count_match_str
Counts non-overlapping occurrences of needle in each string element.
ends_with_dict_dict
Performs string predicate operations between two categorical arrays.
ends_with_dict_str
Performs string predicate operations between categorical and string arrays.
ends_with_str_dict
Performs string predicate operations between string and categorical arrays.
ends_with_str_str
Performs string predicate operations between two string arrays.
find_dict
Finds the first byte index of needle in each categorical string element. Returns -1 if not found.
find_str
Finds the first byte index of needle in each string element. Returns -1 if not found.
join_dict
Joins all non-null categorical string elements with delimiter, returning a single string. Returns None if all elements are null.
join_str
Joins all non-null string elements with delimiter, returning a single string. Returns None if all elements are null.
len_dict
Computes the character length of each string in a CategoricalArray<T> slice, returning an IntegerArray<T> with the same length and null semantics.
len_str
Computes the character length of each string in a StringArray<T> slice, returning an IntegerArray<T> with the same length and null semantics.
ltrim_dict
Trims leading whitespace from each categorical string element.
ltrim_str
Trims leading whitespace from each string element.
max_categorical_array
Finds the lexicographically maximum dictionary string in a categorical array window.
max_string_array
Finds the lexicographically maximum string in a string array window.
min_categorical_array
Finds the lexicographically minimum dictionary string in a categorical array window.
min_string_array
Finds the lexicographically minimum string in a string array window.
pad_dict
Pads each categorical string element to width characters using fill_char.
pad_str
Pads each string element to width characters using fill_char.
repeat_dict
Repeats each categorical string element n times.
repeat_str
Repeats each string element n times.
replace_dict
Replaces all occurrences of from with to in each categorical string element.
replace_str
Replaces all occurrences of from with to in each string element.
reverse_dict
Reverses each categorical string element by Unicode characters.
reverse_str
Reverses each string element by Unicode characters.
rtrim_dict
Trims trailing whitespace from each categorical string element.
rtrim_str
Trims trailing whitespace from each string element.
starts_with_dict_dict
Performs string predicate operations between two categorical arrays.
starts_with_dict_str
Performs string predicate operations between categorical and string arrays.
starts_with_str_dict
Performs string predicate operations between string and categorical arrays.
starts_with_str_str
Performs string predicate operations between two string arrays.
substring_dict
Extracts a character-based substring from each categorical string element.
substring_str
Extracts a character-based substring from each string element. start is the 0-based character offset. opt_len limits the number of characters taken.
to_lowercase_dict
Converts each categorical string element to lowercase.
to_lowercase_str
Converts each string element to lowercase.
to_uppercase_dict
Converts each categorical string element to uppercase.
to_uppercase_str
Converts each string element to uppercase.
trim_dict
Trims leading and trailing whitespace from each categorical string element.
trim_str
Trims leading and trailing whitespace from each string element.