Skip to main content

get_model_max_length

Function get_model_max_length 

Source
pub fn get_model_max_length() -> usize
Expand description

Returns the model’s max input length. Since we no longer have a tokenizer config, this returns the constant from constants.rs. Operators that need a different ceiling should change the compile-time constant or the XDG embedding token policy when exposed via config set.