Struct ModelFactory 

pub struct ModelFactory;

Factory for creating model instances

Implementations

impl ModelFactory

pub async fn create( model_id: &str, config: Option<&Config>, ) -> Result<Box<dyn Model>>

Create a model instance from a model identifier

Format examples:

• “ollama/qwen3-coder:30b” - Explicit backend
• “qwen3-coder:30b” - Auto-detect backend
• “gpt-4” - Search backends (likely vLLM or LiteLLM)

The factory will automatically discover available backends and route the request appropriately.

pub async fn create_default(model_id: &str) -> Result<Box<dyn Model>>

Create a model with default configuration

pub async fn create_with_backend( model_id: &str, config: Option<&Config>, backend: Option<&str>, ) -> Result<Box<dyn Model>>

Create a model with explicit backend preference

If backend is specified, the model_id will be prefixed with the backend name if it’s not already specified. For example:

• backend=“ollama”, model_id=“tinyllama” -> “ollama/tinyllama”
• backend=“vllm”, model_id=“gpt-4” -> “vllm/gpt-4”
• backend=None, model_id=“qwen3-coder:30b” -> auto-detect backend

pub async fn list_all_backend_models() -> Result<Vec<String>>

List all available models from all backends

pub async fn list_available() -> Result<Vec<String>>

List available models (alias for list_all_backend_models)

pub async fn get_available_backends() -> Vec<String>

Get available backends

pub async fn validate(model_id: &str, config: Option<&Config>) -> Result<bool>

Validate that a model is accessible