Expand description
The Backend trait and the executor that picks a bucket and replays its plan.
Structs§
- Batch
- A batch, flattened. Sequence
sis tokenscu[s]..cu[s + 1]and markersmcu[s]..mcu[s + 1], and each marker is a position within its own sequence. - Batch
Buf - Owned storage for a
Batch, reused from one batch to the next so that building one does not allocate once it has grown. - Caps
- What a backend can do.
- Executor
- A graph, its weights on one backend, and a plan per bucket built on first use.
- Host
Tensor - A weight as it sits in the checkpoint, before a backend converts it.
- Outputs
- What a batch produces. Reused across batches, so after the first few it does not allocate.
Enums§
- Error
- Engine errors.
Traits§
- Backend
- A device that runs graphs. The engine is generic over it, so the path through it is monomorphized and there is no dynamic dispatch per op.
Type Aliases§
- Result
- Engine results.