Structs§
- Delta
Aggregator - Aggregates a stream of
NvCreateChatCompletionStreamResponses into a singleNvCreateChatCompletionResponse. This struct accumulates incremental responses from a streaming OpenAI API call into a complete final response. - Delta
Generator - Generates incremental chat completion responses in a streaming fashion.
- NvCreate
Chat Completion Request - A request structure for creating a chat completion, extending OpenAI’s
CreateChatCompletionRequestwithNvExtextensions. - NvCreate
Chat Completion Response - A response structure for unary chat completion responses, embedding OpenAI’s
CreateChatCompletionResponse. - NvCreate
Chat Completion Stream Response - A response structure for streamed chat completions, embedding OpenAI’s
CreateChatCompletionStreamResponse.