create_tokens

layered_nlp

Function create_tokens 

Source 
pub fn create_tokens<F>(input: Vec<InputToken>, get_text_size: F) -> LLLine
where
    F: Fn(&str) -> usize,
👎Deprecated: Use create_line_from_input_tokens
Expand description

Splits the InputTokens and generate TextTags.