Skip to main content

Module bench

Module bench 

Source
Expand description

apr.bench — M2 tool. Benchmark inference throughput (tok/s, latency percentiles).

Wraps apr bench <model> --json [--iterations N] [--max-tokens N] [--prompt X].

Constants§

NAME
Tool name registered with MCP clients.

Functions§

bench_tool_definition
Return the MCP tool definition for apr.bench.
call
Execute apr.bench by spawning apr bench <model> --json [...flags].
dispatch
HELIX-IDEA-002 — unified-signature shim for the inventory dispatcher.