Structs§
- Chat
LogProbs Content - Completion
Tokens Details - Error
Detail - Error
Response - Function
- Function
Call Delta - Function
Call Response - Function
Choice - Function choice specification for ToolChoice::Function
- Image
Url - Json
Schema Format - LogProbs
- Prompt
Token Usage Info - Stream
Options - String
OrArray Iter - Iterator over StringOrArray that yields string references without cloning
- Tool
- Tool
Call - Tool
Call Delta - TopLog
Prob - Usage
- Usage
Info - Usage information (used by rerank and other endpoints)
- Video
Url
Enums§
- Chat
LogProbs - Content
Part - Function
Call - Input
Ids - LoRA
Path - LoRA adapter path - can be single path or batch of paths (SGLang extension)
- Response
Format - String
OrArray - A type that can be either a single string or an array of strings
- Tool
Choice - Tool choice for both Chat Completion and Responses APIs
- Tool
Choice Value - Tool choice value for simple string options
- Tool
Reference - Tool reference for ToolChoice::AllowedTools
Traits§
- Generation
Request - Trait for unified access to generation request properties Implemented by ChatCompletionRequest, CompletionRequest, GenerateRequest, EmbeddingRequest, RerankRequest, and ResponsesRequest
Functions§
- default_
true - Helper function for serde default value (returns true)
- validate_
stop - Validates stop sequences (max 4, non-empty strings) Used by both ChatCompletionRequest and ResponsesRequest