Enum Provider 

pub enum Provider {
    OpenAi,
    OpenRouter,
    Together,
    Vllm,
    Ollama,
}

Available on crate feature live only.

A provider preset.

Variants

OpenAi

OpenAI (OPENAI_API_KEY).

OpenRouter

OpenRouter (OPENROUTER_API_KEY).

Together

Together AI (TOGETHER_API_KEY).

Vllm

A vLLM server (VLLM_API_KEY if it was started with one).

Ollama

A local Ollama (no key).

Implementations

impl Provider

pub const ALL: [Provider; 5]

Every preset, in --provider order.

pub fn name(self) -> &'static str

The --provider name.

pub fn from_name(name: &str) -> Option<Provider>

Preset for a --provider name (case-insensitive).

pub fn default_base_url(self) -> &'static str

Base URL used when --base-url is not given.

pub fn key_env(self) -> Option<(&'static str, bool)>

Environment variable holding the API key, and whether it is required. vLLM only needs a key when the server was started with --api-key.

pub fn default_model(self) -> Option<&'static str>

Model used when --model is not given. None means the user must pick one, because the provider’s catalog (or the local server) decides.

pub fn model_hint(self) -> &'static str

What to suggest when no model was given.

pub fn logprobs_param(self) -> LogprobsParam

How this provider wants logprobs requested.

Trait Implementations

impl Clone for Provider

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Provider

impl Debug for Provider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for Provider

impl PartialEq for Provider

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Provider