Modules§
Structs§
- Audio
Url - Audio
UrlArgs - Builder for
AudioUrl. - Audio
UrlResponse - Base64
Embedding - Represents an base64-encoded embedding vector returned by embedding endpoint.
- Base64
Embedding Vector - Chat
Choice - Chat choice with extended response message.
- Chat
Choice Logprobs - Chat
Choice Stream - Streaming chat choice.
- Chat
Completion Audio - Chat
Completion Functions - Chat
Completion Functions Args - Builder for
ChatCompletionFunctions. - Chat
Completion Message Tool Call - Tool call kept locally to preserve
type: "function"in unary request/response payloads. - Chat
Completion Message Tool Call Chunk - Streaming tool-call chunk.
- Chat
Completion Named Tool Choice - Chat
Completion Request Assistant Message - Assistant message with reasoning content support.
- Chat
Completion Request Assistant Message Args - Builder for
ChatCompletionRequestAssistantMessage. - Chat
Completion Request Assistant Message Audio - Chat
Completion Request Developer Message - Chat
Completion Request Developer Message Args - Builder for
ChatCompletionRequestDeveloperMessage. - Chat
Completion Request Function Message - Chat
Completion Request Function Message Args - Builder for
ChatCompletionRequestFunctionMessage. - Chat
Completion Request Message Content Part Audio - Learn about audio inputs.
- Chat
Completion Request Message Content Part Audio Url - Chat
Completion Request Message Content Part Audio UrlArgs - Builder for
ChatCompletionRequestMessageContentPartAudioUrl. - Chat
Completion Request Message Content Part Image - Image content part – uses our extended
ImageUrlwithurl::Urlanduuid. - Chat
Completion Request Message Content Part Image Args - Builder for
ChatCompletionRequestMessageContentPartImage. - Chat
Completion Request Message Content Part Refusal - Chat
Completion Request Message Content Part Text - Chat
Completion Request Message Content Part Video - Chat
Completion Request Message Content Part Video Args - Builder for
ChatCompletionRequestMessageContentPartVideo. - Chat
Completion Request System Message - Chat
Completion Request System Message Args - Builder for
ChatCompletionRequestSystemMessage. - Chat
Completion Request Tool Message - Tool message
- Chat
Completion Request Tool Message Args - Builder for
ChatCompletionRequestToolMessage. - Chat
Completion Request User Message - Chat
Completion Request User Message Args - Builder for
ChatCompletionRequestUserMessage. - Chat
Completion Response Content Part Audio Url - Response content part for audio URLs in assistant messages
- Chat
Completion Response Content Part Image Url - Response content part for image URLs in assistant messages
- Chat
Completion Response Content Part Text - Response content part for text in assistant messages
- Chat
Completion Response Content Part Video Url - Response content part for video URLs in assistant messages
- Chat
Completion Response Message - Chat completion response message with multimodal content and reasoning.
- Chat
Completion Response Message Audio - Chat
Completion Stream Options - Stream options with per-chunk usage reporting.
- Chat
Completion Stream Response Delta - Streaming delta with reasoning content.
- Chat
Completion Stream Response Delta Function Call - Chat
Completion Token Logprob - Chat
Completion Tool - Chat
Completion Tool Args - Builder for
ChatCompletionTool. - Choice
- Completion
Tokens Details - Breakdown of tokens used in a completion.
- Completion
Usage - Usage statistics for the completion request.
- Create
Base64 Embedding Response - Create
Chat Completion Request - Chat completion request with multimodal processor support.
- Create
Chat Completion Request Args - Builder for
CreateChatCompletionRequest. - Create
Chat Completion Response - Non-streaming chat completion response.
- Create
Chat Completion Stream Response - Streaming chat completion response with extended choices.
- Create
Completion Request - Completion request with inference-serving extensions.
- Create
Completion Request Args - Builder for
CreateCompletionRequest. - Create
Completion Response - Create
Embedding Request - Create
Embedding Request Args - Builder for
CreateEmbeddingRequest. - Create
Embedding Response - Create
Image Edit Request - Create
Image Edit Request Args - Builder for
CreateImageEditRequest. - Create
Image Request - Create
Image Request Args - Builder for
CreateImageRequest. - Create
Image Variation Request - Create
Image Variation Request Args - Builder for
CreateImageVariationRequest. - Edit
Image Json Request - JSON request body for image edits.
- Edit
Image Json Request Args - Builder for
EditImageJsonRequest. - Embedding
- Represents an embedding vector returned by embedding endpoint.
- Embedding
Usage - Function
Call - The name and arguments of a function that should be called.
- Function
Call Stream - Streaming variant of
FunctionCallwhere both fields are optional. - Function
Name - Function
Object - Function
Object Args - Builder for
FunctionObject. - Image
Edit Completed Event - Emitted when image editing has completed and the final image is available.
- Image
Edit Partial Image Event - Emitted when a partial image is available during image editing streaming.
- Image
GenCompleted Event - Emitted when image generation has completed and the final image is available.
- Image
GenInput Usage Details - Image
GenOutput Tokens Details - Image
GenPartial Image Event - Emitted when a partial image is available during image generation streaming.
- Image
GenUsage - Image
Input - Image
RefParam - Reference an input image by either URL or uploaded file ID.
Provide exactly one of
image_urlorfile_id. - Image
Url - Image URL with
url::Urltype and optional UUID. - Image
UrlArgs - Builder for
ImageUrl. - Image
UrlResponse - Images
Response - Input
Audio - Logprobs
- Prompt
Tokens Details - Breakdown of tokens used in a completion.
- Response
Format Json Schema - TopLogprobs
- Video
Url - Video
UrlArgs - Builder for
VideoUrl. - Video
UrlResponse - WebSearch
Location - Approximate location parameters for the search.
- WebSearch
Options - Options for the web search tool.
- WebSearch
User Location
Enums§
- Chat
Completion Audio Format - Chat
Completion Audio Voice - Chat
Completion Function Call - Chat
Completion Message Content - Assistant message content – can be a simple string or multimodal content parts.
- Chat
Completion Request Assistant Message Content - Chat
Completion Request Assistant Message Content Part - Chat
Completion Request Developer Message Content - Chat
Completion Request Message - Chat completion request message enum.
- Chat
Completion Request System Message Content - Chat
Completion Request System Message Content Part - Chat
Completion Request Tool Message Content - Chat
Completion Request Tool Message Content Part - Chat
Completion Request User Message Content - User message content – references our extended content part enum.
- Chat
Completion Request User Message Content Part - User message content part with video and audio URL support.
- Chat
Completion Response Content Part - Content parts for assistant responses supporting multiple modalities
- Chat
Completion Tool Choice Option - Tool choice enum kept locally because upstream changed variant names.
- Chat
Completion Tool Type - Completion
Finish Reason - Dall
E2Image Size - Dall
E3Image Size - Embedding
Input - Encoding
Format - Finish
Reason - Function
Type - GptImage1
Image Size - Image
- Image
Background - Image
Detail - Image detail level. Kept locally because upstream uses different field types in ImageUrl.
- Image
Edit Input - Image
Edit Stream Event - Image
GenStream Event - Image
Model - Image
Moderation - Image
Output Format - Image
Quality - Image
Response Background - Image
Response Format - Image
Size - Image
Style - Input
Audio Format - Input
Fidelity - Prediction
Content - Static predicted output content, such as the content of a text file that is being regenerated.
- Prediction
Content Content - The content that should be matched when generating a model response. If generated tokens would match this content, the entire model response can be returned much more quickly.
- Prompt
- Reasoning
Content - Reasoning content from a previous assistant turn.
- Reasoning
Effort - Response
Format - Role
- Service
Tier - Service
Tier Response - Response tier enum for responses (distinct from request
ServiceTier). - Stop
- OpenAI stop configuration, with Dynamo’s token-id stop extension.
- Stop
Reason - Matched stop condition from the backend.
- WebSearch
Context Size - The amount of context window space to use for the search.
- WebSearch
User Location Type
Type Aliases§
- Chat
Completion Response Stream - Completion
Response Stream - Parsed server side events stream until an [DONE] is received from server.