pub fn get_model_max_length(models_dir: &Path) -> Result<usize, AppError>Expand description
Returns the model’s model_max_length from tokenizer_config.json.
§Errors
Returns Err when the tokenizer files cannot be loaded or the field is missing.