Skip to main content

Module lmstudio

Module lmstudio 

Source
Expand description

LM Studio provider implementation

LM Studio provides multiple API surfaces:

  • OpenAI-compatible endpoints at /v1/* (used by this implementation)
  • Native REST API at /api/v0/* (enhanced stats, model info, model management)
  • Tool calling (since 0.3.6), structured output, and reasoning content (since 0.3.9)

This implementation uses OpenAI-compatible endpoints for maximum compatibility. The native REST API at /api/v0/* provides richer model metadata, load/unload endpoints, and TTL-based auto-evict for JIT-loaded models.

See: https://lmstudio.ai/docs/developer

Re-exports§

pub use client::LMStudioClient;
pub use client::LMSTUDIO_CONNECTION_ERROR;

Modules§

client

Structs§

LmStudioProvider

Functions§

fetch_lmstudio_models
Fetches available models from the LM Studio API endpoint