Function tiktoken_rust::get_encoding
source · pub fn get_encoding(encoding_name: &str) -> Result<Encoding, EncodeError>Expand description
Return Encoding object TODO: cache created Encoding object
pub fn get_encoding(encoding_name: &str) -> Result<Encoding, EncodeError>Return Encoding object TODO: cache created Encoding object