Module sampling_params 

Structs

SamplingParams

Sampling parameters for text generation

Functions

validate_top_k_value

Validates top_k: -1 (disabled) or >= 1 (special -1 case - can’t use range validator)

validate_top_p_value

Validates top_p: 0.0 < top_p <= 1.0 (can’t use range validator for open interval)