Struct OllamaSetConfig 

pub struct OllamaSetConfig {
    pub enabled: bool,
    pub host: String,
    pub port: u16,
    pub chat_model: String,
    pub embedding_model: String,
    pub timeout_seconds: u64,
    pub max_retries: u32,
    pub fallback_to_hash: bool,
    pub max_tokens: Option<u32>,
    pub temperature: Option<f32>,
    pub keep_alive: Option<String>,
    pub num_ctx: Option<u32>,
}

Ollama-specific configuration for local LLM and embeddings

Fields

enabled: bool

Enable Ollama integration

host: String

Ollama host

port: u16

Ollama port

chat_model: String

Chat model name

embedding_model: String

Embedding model name

timeout_seconds: u64

Timeout in seconds

max_retries: u32

Maximum retries

fallback_to_hash: bool

Fallback to hash-based embeddings

max_tokens: Option<u32>

Maximum tokens

temperature: Option<f32>

Temperature

keep_alive: Option<String>

How long to keep the model loaded in memory (e.g. “1h”, “30m”, “0”)

Critical for KV Cache efficiency when processing multiple chunks from the same document.

num_ctx: Option<u32>

Context window size in tokens (overrides Ollama model default)

Ollama silently truncates prompts exceeding the context window. Set this when processing long documents to avoid silent truncation.

Trait Implementations

impl Clone for OllamaSetConfig

fn clone(&self) -> OllamaSetConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OllamaSetConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for OllamaSetConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for OllamaSetConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for OllamaSetConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.