Enum ProviderConfig 

pub enum ProviderConfig {
    Bedrock {
        model_id: String,
        region: Option<String>,
    },
    Paddock {
        base_url: String,
        model: String,
        api_key: Option<String>,
    },
    Native {
        base_dir: Option<PathBuf>,
        lora_dir: Option<PathBuf>,
    },
    Needle {
        base_url: String,
    },
}

Variants

Bedrock

Claude on AWS Bedrock via the Converse API. region: None uses the environment/default chain.

Fields

model_id: String

region: Option<String>

Paddock

Local Paddock (OpenAI-compatible /chat/completions). base_url includes the /v1 path.

Fields

base_url: String

model: String

api_key: Option<String>

Native

Native in-process inference (pure-Rust candle): tuned Qwen3-1.7B + shipped LoRA, fully offline, no server. base_dir/lora_dir = None resolves to the HF cache / bundled defaults at build.

Fields

base_dir: Option<PathBuf>

lora_dir: Option<PathBuf>

Needle

Cactus Needle: the 26M tool-use-native model via its /generate server (needle-code torch port).

Fields

base_url: String

Implementations

impl ProviderConfig

pub fn bedrock_default() -> Self

pub fn paddock_default() -> Self

pub fn resolve(default_base_url: &str, default_model: &str) -> ProviderConfig

Resolve the provider in layers: built-in defaults → config file → environment. This is the product path: a user points SteelDB at ANY OpenAI-compatible endpoint (OpenRouter, OpenAI, Together, Groq, vLLM, a local server) with one small config file — no code, no rebuild.

Config file (./steeldb.json or $STEELDB_CONFIG or ~/.steeldb/config.json):

{ "llm": { "provider": "openai", "base_url": "https://openrouter.ai/api/v1",
           "model": "anthropic/claude-3.5-sonnet", "api_key": "sk-or-..." } }

provider: "openai" (or “paddock”/“local”) → the OpenAI-compatible client; "bedrock" → Claude on AWS. Env vars (STEELDB_LLM, STEELDB_PADDOCK_URL, STEELDB_PADDOCK_MODEL, STEELDB_API_KEY, STEELDB_BEDROCK_MODEL, AWS_REGION) override the file.

pub fn from_env() -> ProviderConfig

Read a config from env: STEELDB_LLM=bedrock|paddock plus backend-specific vars (STEELDB_BEDROCK_MODEL, AWS_REGION; STEELDB_PADDOCK_URL, STEELDB_PADDOCK_MODEL).

pub async fn build(&self) -> Result<Box<dyn LlmProvider>, String>

Construct the provider. Errors if the selected backend’s feature is not compiled in.

Trait Implementations

impl Clone for ProviderConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProviderConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.