ZL_CustomTokenizeState_createIndexOutput

openzl_sys

Function ZL_CustomTokenizeState_createIndexOutput 

Source 
pub unsafe extern "C" fn ZL_CustomTokenizeState_createIndexOutput(
    ctx: *mut ZL_CustomTokenizeState,
    indexWidth: usize,
) -> *mut c_void
Expand description

Creates the index stream with the given width. The index stream must contain exactly the same number of elements as the input.

@param indexWidth The width of the index integer, either 1, 2, 4, or 8.

@returns A pointer to write the indices into or NULL on error.