Expand description
Run command - Interactive chat with a model (ollama-style)
Structs§
Enums§
- Output
Format - Output format for
ferrum run. JSONL mode emits one record per event (assistant generation result, user input, exit) on stdout — used by integration tests and scripting. Text mode is the default interactive UX.
Functions§
- apply_
kv_ dtype_ override - Apply the resolved
--kv-dtype/ runtime-config override to an engine config, validating syntax early. The registered numerical profiles and actual backend providers validate the requested FP16/INT8 combination. - execute
- select_
device