llama_core

Module chat

Source
Expand description

Define APIs for chat completion.

Functionsยง

chat
Processes a chat-completion request and returns either a stream of ChatCompletionChunk instances or a ChatCompletionObject instance.
chat_completionsDeprecated
Processes a chat-completion request and returns a ChatCompletionObject instance.
chat_completions_streamDeprecated
Processes a chat-completion request and returns ChatCompletionChunk instances in stream.