Expand description
Large language model traits and types
Modules§
- common
- Common functions for model evaluation
Structs§
- Model
Parameters - Parameters for tuning model instances
- Output
Request - Used in a call to Model::evaluate or InferenceSession::infer to request
information from the model. If a value is set to
Some, theVecwill be cleared, resized, and filled with the related data.
Enums§
- Hyperparameters
Write Error - Reported from functions that write
Traits§
- Hyperparameters
- Implemented by model hyperparameters for interacting with hyperparameters without knowing what they are, as well as writing/reading them as required.
- Known
Model - Interfaces for creating and interacting with a large language model with a known type of hyperparameters.
- Model
- A type-erased model to allow for interacting with a model without knowing its hyperparameters.