Module sampling 

Sampling and generation parameters

Structs

MirostatParams

Mirostat sampling parameters

SamplingParams

Sampling parameters for generation

SamplingPresets

Sampling presets

SpecialTokens

Special tokens configuration

Enums

FinishReason

Reason for completion

Priority

Request priority levels

ResponseFormat

Response format for structured output.