Expand description
Declared optional features of an crate::ExecutableGraph.
The ExecutableGraph trait grew a long tail of
defaulted methods (MoE residency, GPU handles, KV row feeds, async
pipeline, …). Most backends leave those as no-ops / false. Callers that
need to branch on support should prefer:
- [
ExecutableGraph::capabilities] for a cheap advisory bitmask, then - the concrete method’s return value (
false/None) as the source of truth — capabilities can lag a backend that forgot to override them.
Method groups on ExecutableGraph:
| Group | Methods |
|---|---|
| Core run | set_param, run, run_raw, run_slots, arena_ptr, finalize_params |
| Clone | clone_box |
| Extent / RNG | set_active_extent, set_rng, rng |
| MoE | set_moe_resident_experts*, enable_moe_topk_capture, take_moe_* |
| Persistent / GPU handles | bind_handle, read_handle, bind_gpu_handle, … |
| KV resident | register_kv_row_feed, feed_kv_row, seed_resident_kv_prefix_from, … |
| Typed I/O | set_param_typed, run_typed |
| Async pipeline | commit_no_wait, sync_pending, run_pipelined |
Structs§
- Executable
Capabilities - Advisory feature flags for a compiled executable.