Ailloli Inference
ailloli_inference is the model inference component of the Ailloli ecosystem.
It defines the abstractions used to configure and run local or remote model
inference for Ailloli applications.
Status
Early development. The public API is experimental and subject to change.
MSRV
Rust 1.88.
License
Ailloli Inference is dual-licensed under Apache-2.0 or MIT, at your option.