Skip to main content

get_model_max_length

Function get_model_max_length 

Source
pub fn get_model_max_length() -> usize
Expand description

Returns the model’s max input length. Since we no longer have a tokenizer config, this returns the constant from constants.rs. Operators that need a different ceiling should set SQLITE_GRAPHRAG_EMBEDDING_MAX_TOKENS in the environment.