Crate blazen_local_llm 

Shared option + request types for Blazen’s local-LLM backends.

Sits below blazen-llm-candle, blazen-llm-mistralrs, blazen-llm-llamacpp, blazen-llm (orchestrator), and blazen-controlplane so that all five can agree on a single strongly-typed shape for “options that apply to any local LLM” (the LocalLlmOptions base) and “a typed request to materialise a local model” (the LocalModelRequest carried through the factory seam in blazen-llm::providers::factory).

Backend-specific knobs (e.g. candle’s force_safetensors, llama.cpp’s n_gpu_layers, mistral.rs’s vision) stay on each backend’s own Options struct, which embeds LocalLlmOptions via a pub base: LocalLlmOptions field. Use the [LocalLlmOptionsBuilder] convenience type for ergonomic construction.

Structs

LocalLlmOptions

Options shared by every local-LLM backend (candle, mistralrs, llama.cpp). Embedded as the base field on each backend’s own *Options struct.

LocalModelRequest

A typed request to materialise a local model, carried through the LocalModelFactory seam in blazen-llm::providers::factory. Replaces the previous (provider: &str, model: &str) two-string signature so that downstream code (controlplane ManagerHandle, the per-binding facades) can plumb a full LocalLlmOptions payload through end-to-end.