Skip to main content

default_chat_sampling_params

Function default_chat_sampling_params 

Source
pub fn default_chat_sampling_params() -> SamplingParams
Expand description

Product defaults used when an OpenAI chat request omits sampling fields. The engine composition root consumes the same typed value so its resolved startup plan cannot describe different defaults from the HTTP endpoint.