Expand description
Model configuration, listing, and benchmarking.
Reads presets from .battlecommand/models.toml. Queries Ollama API for available models. Benchmarks models with a standard prompt.
Structs§
Functions§
- benchmark_
model - Benchmark a model by sending a standard prompt and measuring tokens/sec.
- estimate_
vram_ gb - Estimate VRAM usage for a model based on parameter count and quantization.
- get_
preset - Get the preset configuration for a given preset name.
- list_
ollama_ models - List all available Ollama models.