Function layered_nlp::create_tokens [−][src]
pub fn create_tokens<F>(input: Vec<InputToken>, get_text_size: F) -> LLLine where
F: Fn(&str) -> usize,
👎 Deprecated:
Use create_line_from_input_tokens
Splits the InputToken
s and generate TextTag
s.