Function tiktoken_rust::get_encoding
source · pub fn get_encoding(encoding_name: &str) -> Result<Encoding>
Expand description
Return Encoding object TODO: cache created Encoding object
pub fn get_encoding(encoding_name: &str) -> Result<Encoding>
Return Encoding object TODO: cache created Encoding object