Struct CompatibleConfig 

pub struct CompatibleConfig {
    pub provider_name: String,
    pub api_key: String,
    pub base_url: String,
    pub model: String,
    pub max_tokens: u32,
    pub embedding_model: Option<String>,
    pub completion_tokens_param: Option<CompletionTokensParam>,
    pub vision: Option<bool>,
}

Configuration for CompatibleProvider.

Pass to CompatibleProvider::new instead of individual positional arguments to avoid silent parameter transposition.

Examples

use zeph_llm::compatible::{CompatibleConfig, CompatibleProvider};

let cfg = CompatibleConfig {
    provider_name: "together-ai".into(),
    api_key: "key".into(),
    base_url: "https://api.together.xyz/v1".into(),
    model: "meta-llama/Llama-3.3-70B-Instruct-Turbo".into(),
    max_tokens: 4096,
    embedding_model: None,
    completion_tokens_param: None,
    vision: None,
};
let provider = CompatibleProvider::new(cfg);

Fields

provider_name: String

Human-readable provider name used in logs and LlmProvider::name.

api_key: String

Secret API key sent in the Authorization: Bearer header.

base_url: String

Base URL of the endpoint, e.g. "https://api.together.xyz/v1".

model: String

Chat model identifier.

max_tokens: u32

Upper bound on completion tokens returned by the model.

embedding_model: Option<String>

Embedding model identifier. Set to None when the endpoint does not support embeddings.

completion_tokens_param: Option<CompletionTokensParam>

Override which token-limit parameter is used in API requests.

When None, the provider infers the correct field from the model name via the built-in prefix table. Set explicitly for models the table does not recognise (e.g. fine-tuned reasoning models whose names do not start with o + digit).

vision: Option<bool>

Explicit vision-capability override.

OpenAiProvider’s built-in model-name prefix table cannot recognise arbitrary compatible endpoint model names (Together AI, local vLLM, etc.), so it fails safe to false for all of them. Set this when the endpoint’s configured model actually accepts image input.

Trait Implementations

impl Clone for CompatibleConfig

fn clone(&self) -> CompatibleConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompatibleConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.