pub struct MlxCompiledMultiOutputGraph { /* private fields */ }Expand description
Owns one compiled MLX graph that produces an ordered vector of outputs.
Model-side compiled composites that need several outputs at once — the
multi-token-prediction verification window returns successor states beside
its logits — construct one of these with their own graph builder and apply
it through MlxBindingsContext::apply_compiled_multi_output_graph. Output
order is the builder’s write order and never changes after compilation.
Implementations§
Source§impl MlxCompiledMultiOutputGraph
impl MlxCompiledMultiOutputGraph
Sourcepub fn new(
graph_builder: MlxGraphBuilder,
compile_operation: &'static str,
shapeless: bool,
) -> Result<Self, MlxCError>
pub fn new( graph_builder: MlxGraphBuilder, compile_operation: &'static str, shapeless: bool, ) -> Result<Self, MlxCError>
Compiles the given graph builder into a replayable multi-output graph.
The shapeless flag carries the same shape-specialization tradeoff as
the single-output compiled graph constructor.
Trait Implementations§
Auto Trait Implementations§
impl !Send for MlxCompiledMultiOutputGraph
impl !Sync for MlxCompiledMultiOutputGraph
impl Freeze for MlxCompiledMultiOutputGraph
impl RefUnwindSafe for MlxCompiledMultiOutputGraph
impl Unpin for MlxCompiledMultiOutputGraph
impl UnsafeUnpin for MlxCompiledMultiOutputGraph
impl UnwindSafe for MlxCompiledMultiOutputGraph
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more