prepare_for_evaluate

llm_base::model::common

Function prepare_for_evaluate 

Source 
pub fn prepare_for_evaluate(
    n_layer: usize,
    session: &mut InferenceSession,
    input_tokens: &[TokenId],
) -> (Context, Tensor)
Expand description

Common code to prepare a model to evaluate input