Skip to main content

Module eval_prompt

Module eval_prompt 

Source
Expand description

harn eval prompt <file> --fleet <models> โ€” render and optionally run a single .harn.prompt template across a fleet of models so authors can validate the capability-adapted envelope per model side-by-side.

Render mode is the v1 acceptance path: it pushes an LLM render context per model, calls the template engine, and emits the rendered envelope plus a wire-format diff. Run and judge modes synthesize a tiny Harn driver and route through the existing execute_run pipeline so credentialed LLM calls, mock fixtures, and the LlmRenderContext injection all stay on the canonical path.

Functionsยง

run