Struct LatticeInput 

pub struct LatticeInput<'a> {
    pub bytes: &'a [u8],
    pub can_bow: &'a [u8],
    pub char_categories: &'a [u32],
    pub word_candidate_lengths: &'a [u32],
    pub continuous_lengths: &'a [u32],
    pub code_point_byte_lengths_flat: &'a [u8],
    pub code_point_offsets: &'a [u32],
}

Pre-packed input text data for lattice construction.

Fields

bytes: &'a [u8]

can_bow: &'a [u8]

char_categories: &'a [u32]

word_candidate_lengths: &'a [u32]

continuous_lengths: &'a [u32]

code_point_byte_lengths_flat: &'a [u8]

code_point_offsets: &'a [u32]