Skip to main content

detect_encoding

Function detect_encoding 

Source
pub fn detect_encoding(model: &str) -> Option<TokenEncoding>
Expand description

Detect the appropriate encoding for a model name