Struct LMStudioConfig 

pub struct LMStudioConfig {
    pub base_url: String,
    pub default_model: String,
    pub max_context_tokens: usize,
    pub retry_policy: RetryPolicy,
}

Configuration for LM Studio local models.

LM Studio provides an OpenAI-compatible API for running local models. No API key is required since it runs locally.

Example

use multi_llm::LMStudioConfig;

let config = LMStudioConfig {
    base_url: "http://localhost:1234".to_string(),
    default_model: "local-model".to_string(),
    max_context_tokens: 4096,
    ..Default::default()
};

Environment Variables

• LM_STUDIO_BASE_URL or OPENAI_BASE_URL: Server URL (default: http://localhost:1234)

Notes

• Start LM Studio server before making requests
• Context window depends on the loaded model
• Model name in config is ignored; uses whatever model is loaded in LM Studio

Fields

base_url: String

Base URL for the LM Studio server (default: http://localhost:1234).

default_model: String

Default model name (LM Studio uses the loaded model regardless).

max_context_tokens: usize

Maximum context window size (depends on loaded model).

retry_policy: RetryPolicy

Retry policy for transient failures.

Trait Implementations

impl Clone for LMStudioConfig

fn clone(&self) -> LMStudioConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LMStudioConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LMStudioConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for LMStudioConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl ProviderConfig for LMStudioConfig

fn provider_name(&self) -> &'static str

Get the provider identifier (e.g., “openai”, “anthropic”).

fn max_context_tokens(&self) -> usize

Get the maximum context window size in tokens.

fn validate(&self) -> LlmResult<()>

Validate that the configuration is complete and valid.

fn base_url(&self) -> &str

Get the base URL for API requests.

fn api_key(&self) -> Option<&str>

Get the API key, if one is configured.

fn default_model(&self) -> &str

Get the default model name for this provider.

fn as_any(&self) -> &dyn Any

Downcast helper for accessing concrete config types.

fn retry_policy(&self) -> &RetryPolicy

Get the retry policy for transient failures.

impl Serialize for LMStudioConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.