Skip to main content

Module types

llm_kernel::llm

Module types

Expand description

Core LLM request/response types. Core types for the LLM client module.

Structs§

ChatMessage: A single message in a chat conversation.
LLMRequest: A chat completion request to an LLM provider.
LLMRequestBuilder: Builder for constructing LLMRequest instances with a fluent API.
LLMResponse: A chat completion response from an LLM provider.
ModelConfig: Configuration for a specific LLM model and provider.
TokenUsage: Token usage statistics from an LLM response.

Enums§

ContentPart: A single content part in a multimodal chat message.
MessageRole: Role of a message sender in a chat conversation.
ResponseFormat: Desired output format for the LLM response.
StreamEvent: A single event in an LLM streaming response.

Type Aliases§

LLMStream: Type alias for a boxed streaming response.