Skip to main content

Crate burn_central_inference

Crate burn_central_inference 

Source
Expand description

Inference contracts and type-erased adapters.

Re-exports§

pub use erased::ErasedInference;
pub use erased::ErasedInferenceWriter;
pub use erased::JsonInference;

Modules§

erased
observer
stream

Structs§

InferenceWrapper
InferenceWriter
Communication channel for an inference task, allowing the app to send outputs and errors back to the session.

Enums§

InferenceWriterError
Errors that can occur when writing to an inference channel.

Traits§

Inference
InferenceWriterChannel
Trait representing an inference task that can be executed with a given input and a writer for outputs. The inference implementation is responsible for writing outputs and errors to the provided writer, which will be sent back to the session.