llama_core

Module chat

source
Expand description

Define APIs for chat completion.

Functionsยง

  • chat
    Processes a chat-completion request and returns either a stream of ChatCompletionChunk instances or a ChatCompletionObject instance.
  • chat_completionsDeprecated
    Processes a chat-completion request and returns a ChatCompletionObject instance.
  • chat_completions_streamDeprecated
    Processes a chat-completion request and returns ChatCompletionChunk instances in stream.