Skip to main content Module common Copy item path Source ChatLogProbsContent CompletionTokensDetails ErrorDetail ErrorResponse Function FunctionCallDelta FunctionCallResponse FunctionChoice Function choice specification for ToolChoice::Function ImageUrl JsonSchemaFormat LogProbs PromptTokenUsageInfo Redacted ResponsePrompt Reference to a prompt template and its variables. StreamOptions StringOrArrayIter Iterator over StringOrArray that yields string references without cloning Tool ToolCall ToolCallDelta TopLogProb Usage UsageInfo Usage information (used by rerank and other endpoints) VideoUrl ChatLogProbs ContentPart Detail Image detail level for [PromptVariableTyped::InputImage]. FunctionCall Deprecated function_call field from the OpenAI API.
Can be "none", "auto", or {"name": "function_name"}. InputIds LoRAPath LoRA adapter path - can be single path or batch of paths (SGLang extension) PromptVariable A prompt variable value: plain string or a typed input (text, image, file). PromptVariableTyped Typed prompt variable input. ResponseFormat StringOrArray A type that can be either a single string or an array of strings ToolChoice Tool choice for both Chat Completion and Responses APIs ToolChoiceValue Tool choice value for simple string options ToolReference Tool reference for ToolChoice::AllowedTools GenerationRequest Trait for unified access to generation request properties
Implemented by ChatCompletionRequest, CompletionRequest, GenerateRequest,
EmbeddingRequest, RerankRequest, and ResponsesRequest default_true Helper function for serde default value (returns true) validate_stop Validates stop sequences (max 4, non-empty strings)
Used by both ChatCompletionRequest and ResponsesRequest