Struct CompatibleConfig 

pub struct CompatibleConfig {
    pub provider_name: String,
    pub api_key: String,
    pub base_url: String,
    pub model: String,
    pub max_tokens: u32,
    pub embedding_model: Option<String>,
}

Configuration for CompatibleProvider.

Pass to CompatibleProvider::new instead of individual positional arguments to avoid silent parameter transposition.

Examples

use zeph_llm::compatible::{CompatibleConfig, CompatibleProvider};

let cfg = CompatibleConfig {
    provider_name: "together-ai".into(),
    api_key: "key".into(),
    base_url: "https://api.together.xyz/v1".into(),
    model: "meta-llama/Llama-3.3-70B-Instruct-Turbo".into(),
    max_tokens: 4096,
    embedding_model: None,
};
let provider = CompatibleProvider::new(cfg);

Fields

provider_name: String

Human-readable provider name used in logs and LlmProvider::name.

api_key: String

Secret API key sent in the Authorization: Bearer header.

base_url: String

Base URL of the endpoint, e.g. "https://api.together.xyz/v1".

model: String

Chat model identifier.

max_tokens: u32

Upper bound on completion tokens returned by the model.

embedding_model: Option<String>

Embedding model identifier. Set to None when the endpoint does not support embeddings.

Trait Implementations

impl Clone for CompatibleConfig

fn clone(&self) -> CompatibleConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompatibleConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.