Function tiktoken_rust::encoding_for_model
source · pub fn encoding_for_model(model_name: &str) -> Result<Encoding>
Expand description
Returns the encoding used by a model.
pub fn encoding_for_model(model_name: &str) -> Result<Encoding>
Returns the encoding used by a model.