Module aggregator

Module aggregator 

Source

Structs§

DeltaAggregator
Aggregates a stream of NvCreateChatCompletionStreamResponses into a single NvCreateChatCompletionResponse. This struct accumulates incremental responses from a streaming OpenAI API call into a complete final response.

Traits§

ChatCompletionAggregator
Trait for aggregating chat completion responses from streams. Setting this macro because our async functions are not used outside of the library