Expand description
apr.bench — M2 tool. Benchmark inference throughput (tok/s, latency percentiles).
Wraps apr bench <model> --json [--iterations N] [--max-tokens N] [--prompt X].
Constants§
- NAME
- Tool name registered with MCP clients.
Functions§
- bench_
tool_ definition - Return the MCP tool definition for
apr.bench. - call
- Execute
apr.benchby spawningapr bench <model> --json [...flags]. - dispatch
- HELIX-IDEA-002 — unified-signature shim for the inventory dispatcher.