Skip to main content

Module models

Module models 

Source
Expand description

Model configuration, listing, and benchmarking.

Reads presets from .battlecommand/models.toml. Queries Ollama API for available models. Benchmarks models with a standard prompt.

Structs§

BenchmarkResult
ModelInfo
PresetConfig

Functions§

benchmark_model
Benchmark a model by sending a standard prompt and measuring tokens/sec.
estimate_vram_gb
Estimate VRAM usage for a model based on parameter count and quantization.
get_preset
Get the preset configuration for a given preset name.
list_ollama_models
List all available Ollama models.