pub type ZL_CustomTokenizeFn = Option<unsafe extern "C" fn(ctx: *mut ZL_CustomTokenizeState, input: *const ZL_Input) -> ZL_Report>;Expand description
A custom tokenization function to tokenize the input. The output of this function is not checked in production builds, and it is UB to tokenize incorrectly.
Aliased Type§
pub enum ZL_CustomTokenizeFn {
None,
Some(unsafe extern "C" fn(*mut ZL_CustomTokenizeState_s, *const ZL_Input_s) -> ZL_Result_size_t_u),
}Variants§
None
No value.
Some(unsafe extern "C" fn(*mut ZL_CustomTokenizeState_s, *const ZL_Input_s) -> ZL_Result_size_t_u)
Some value of type T.