Skip to main content

rough_token_count

Function rough_token_count 

Source
pub fn rough_token_count(src: &str) -> usize
Expand description

Returns the number of tokens in a source string (whitespace-split).