Expand description
Knobs that control how the model produces text.
Structs§
- Generation
Options - Generation knobs. All fields are optional; unset fields keep the model’s defaults.
Enums§
- Sampling
Mode - Strategy used when sampling the next token.
Knobs that control how the model produces text.