Module llama_core::chat

source ·
Expand description

Define APIs for chat completion.

Functions§

  • chat
    Processes a chat-completion request and returns either a stream of ChatCompletionChunk instances or a ChatCompletionObject instance.
  • chat_completionsDeprecated
    Processes a chat-completion request and returns a ChatCompletionObject instance.
  • chat_completions_streamDeprecated
    Processes a chat-completion request and returns ChatCompletionChunk instances in stream.