Skip to main content

Module run

Module run 

Source
Expand description

Run command - Interactive chat with a model (ollama-style)

Structs§

RunCommand

Enums§

OutputFormat
Output format for ferrum run. JSONL mode emits one record per event (assistant generation result, user input, exit) on stdout — used by integration tests and scripting. Text mode is the default interactive UX.

Functions§

apply_kv_dtype_override
Apply the resolved --kv-dtype / runtime-config override to an engine config, validating syntax early. The registered numerical profiles and actual backend providers validate the requested FP16/INT8 combination.
execute
select_device