Expand description
Common functions for model evaluation
Functionsยง
- extract_
embeddings - Extract embeddings from OutputRequest evaluation
- extract_
logits - Extract logits from OutputRequest evaluation
- prepare_
for_ evaluate - Common code to prepare a model to evaluate input
- read_
last_ token - Return result for just the last token
- update_
session - Update an InferenceSession after evaluation