Expand description
Inference contracts and type-erased adapters.
Re-exports§
pub use erased::ErasedInference;pub use erased::ErasedInferenceWriter;pub use erased::JsonInference;
Modules§
Structs§
- Inference
Wrapper - Inference
Writer - Communication channel for an inference task, allowing the app to send outputs and errors back to the session.
Enums§
- Inference
Writer Error - Errors that can occur when writing to an inference channel.
Traits§
- Inference
- Inference
Writer Channel - Trait representing an inference task that can be executed with a given input and a writer for outputs. The inference implementation is responsible for writing outputs and errors to the provided writer, which will be sent back to the session.