Struct LlmConfigBuilder 

pub struct LlmConfigBuilder { /* private fields */ }

Builder for LlmConfig.

Implementations

impl LlmConfigBuilder

pub fn provider(self, provider: Provider) -> Self

Set the LLM provider. Required.

pub fn base_url(self, base_url: impl Into<String>) -> Self

Set the base URL of the LLM endpoint. Required.

pub fn model(self, model: impl Into<String>) -> Self

Set the model name. Required.

pub fn api_key(self, api_key: impl Into<String>) -> Self

Set the API key. Optional for local providers.

pub fn num_ctx(self, num_ctx: u32) -> Self

Set the context window size sent in the options.num_ctx field of Ollama requests. Defaults to 4096. Ignored by OpenAI-compatible and Anthropic providers; use max_tokens for those.

pub fn max_tokens(self, max_tokens: u32) -> Self

Set the maximum number of generated tokens sent in the max_tokens field of OpenAI-compatible and Anthropic requests. Defaults to 4096. Ignored by Ollama; use num_ctx for that.

pub fn build(self) -> Result<LlmConfig, LlmConfigError>

Build the LlmConfig.

Trait Implementations

impl Default for LlmConfigBuilder

fn default() -> LlmConfigBuilder

Returns the “default value” for a type.