dynamo_llm::protocols::openai

Module chat_completions

Source

Structs§

DeltaAggregator
Aggregates a stream of NvCreateChatCompletionStreamResponses into a single NvCreateChatCompletionResponse. This struct accumulates incremental responses from a streaming OpenAI API call into a complete final response.
DeltaGenerator
Generates incremental chat completion responses in a streaming fashion.
NvCreateChatCompletionRequest
A request structure for creating a chat completion, extending OpenAI’s CreateChatCompletionRequest with NvExt extensions.
NvCreateChatCompletionResponse
A response structure for unary chat completion responses, embedding OpenAI’s CreateChatCompletionResponse.
NvCreateChatCompletionStreamResponse
A response structure for streamed chat completions, embedding OpenAI’s CreateChatCompletionStreamResponse.