liquid-edge 0.2.3

Minimal edge inference runtime for LLMs
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18

//! # Liquid Edge - Generic Edge Inference Runtime
//!
//! A lightweight, efficient inference runtime designed for edge computing environments.
//! Supports multiple backends for running deep learning models on edge devices.

pub mod device;
pub mod error;
pub mod model;
pub mod runtime;

// Re-exports
pub use device::{cpu, cpu_with_threads, cuda, cuda_default, Device};

#[cfg(target_arch = "wasm32")]
pub use device::webgpu;
pub use error::{EdgeError, EdgeResult};
pub use model::Model;
pub use runtime::{InferenceInput, InferenceOutput, InferenceRuntime, RuntimeBackend};