Module aggregator

dynamo_llm::protocols::openai::chat_completions

Module aggregator 

Source

Structs§

DeltaAggregator
Aggregates a stream of NvCreateChatCompletionStreamResponses into a single NvCreateChatCompletionResponse. This struct accumulates incremental responses from a streaming OpenAI API call into a complete final response.

Traits§

ChatCompletionAggregator
Trait for aggregating chat completion responses from streams. Setting this macro because our async functions are not used outside of the library