Module chat_completion

This module enables the implementation of chat completion on LLM providers

The main trait to implement is ChatCompletion, which takes a ChatCompletionRequest and returns a ChatCompletionResponse.

A chat completion request is comprised of a list of ChatMessage to complete, with optionally tool specifications. The response optionally contains a message and zero or more tool calls.

Modules

• errors

Structs

• ChatCompletionRequest
  A chat completion request represents a series of chat messages and tool interactions that can be send to any LLM.
• ChatCompletionRequestBuilder
  Builder for ChatCompletionRequest.
• ChatCompletionResponse
• ChatCompletionResponseBuilder
  Builder for ChatCompletionResponse.
• ParamSpec
• ParamSpecBuilder
  Builder for ParamSpec.
• ToolCall
  A tool call that can be executed by the executor
• ToolCallBuilder
  Builder for ToolCall.
• ToolSpec
  A typed tool specification intended to be usable for multiple LLMs
• ToolSpecBuilder
  Builder for ToolSpec.

Enums

• ChatCompletionRequestBuilderError
  Error type for ChatCompletionRequestBuilder
• ChatMessage
• ParamSpecBuilderError
  Error type for ParamSpecBuilder
• ToolCallBuilderError
  Error type for ToolCallBuilder
• ToolOutput
  Output of a ToolCall which will be added as a message for the agent to use.
• ToolSpecBuilderError
  Error type for ToolSpecBuilder

Traits

• ChatCompletion
• Tool