llm_base::model::common

Function update_session

Source 
pub fn update_session(
    session: &mut InferenceSession,
    ctx0: &Context,
    n_input: usize,
    n: usize,
)
Expand description

Update an InferenceSession after evaluation