ZL_Compressor_registerCustomTokenizeGraph

Function ZL_Compressor_registerCustomTokenizeGraph 

Source
pub unsafe extern "C" fn ZL_Compressor_registerCustomTokenizeGraph(
    cgraph: *mut ZL_Compressor,
    streamType: ZL_Type,
    customTokenizeFn: ZL_CustomTokenizeFn,
    opaque: *const c_void,
    alphabetGraph: ZL_GraphID,
    indicesGraph: ZL_GraphID,
) -> ZL_GraphID
Expand description

Tokenize with a custom tokenization function. This is useful if you want to define a custom order for your alphabet that is neither insertion nor sorted order.

WARNING: Zstrong does not manage the lifetime of the @p opaque pointer. It must outlive the @p cgraph or be NULL.