ZL_CustomTokenizeFn

Type Alias ZL_CustomTokenizeFn 

Source
pub type ZL_CustomTokenizeFn = Option<unsafe extern "C" fn(ctx: *mut ZL_CustomTokenizeState, input: *const ZL_Input) -> ZL_Report>;
Expand description

A custom tokenization function to tokenize the input. The output of this function is not checked in production builds, and it is UB to tokenize incorrectly.

Aliased Type§

pub enum ZL_CustomTokenizeFn {
    None,
    Some(unsafe extern "C" fn(*mut ZL_CustomTokenizeState_s, *const ZL_Input_s) -> ZL_Result_size_t_u),
}

Variants§

§1.0.0

None

No value.

§1.0.0

Some(unsafe extern "C" fn(*mut ZL_CustomTokenizeState_s, *const ZL_Input_s) -> ZL_Result_size_t_u)

Some value of type T.