Expand description
Forward execution strategies for crate::GraphSession.
Each strategy defines HOW input data flows through a compiled graph:
Standard— full input at once, with inference cachingStream— chunked input throughcrate::StreamRun, respecting StreamModeBatched— rows from aDataStore, batch by batch (memory-bounded)
Structs§
- Batched
- Batched forward: read rows from a DataStore in fixed-size batches. Keeps memory bounded — only one batch is materialized at a time.
- Forward
Env - What a forward pass runs against, besides the graph and the data.
- Standard
- Full input at once, with inference caching.
- Stream
- Chunked input through
crate::StreamRun, respecting each filter’sStreamMode.
Traits§
- Forward
Strategy - How a forward pass feeds data through the compiled graph.