inferd-engine 0.2.1

Backend trait and adapters for inferd. v0.1: mock + libllama (FFI). v0.2: cloud adapters.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24

//! `libllama` backend adapter (M2b).
//!
//! Implements the `Backend` trait against the FFI bindings generated by
//! `build.rs`. Compiled in only when the `llamacpp` cargo feature is on
//! (default builds use the `mock` adapter — see ADR 0005).
//!
//! The adapter splits two concerns:
//! - [`loader`] — open + verify + load the model file (THREAT_MODEL F-5,
//!   F-6).
//! - [`backend`] — the `Backend` impl: context, generation, cancellation.

pub mod backend;
pub mod chat_template;
pub mod loader;
pub mod mtmd;
pub mod tool_parser;

pub use backend::{LlamaCpp, LlamaCppConfig, LlamaCppError};
pub use chat_template::{Gemma4RenderError, Gemma4Rendered, Gemma4Renderer};
pub use loader::{ModelHandle, ModelLoadError, load_model};
pub use mtmd::{
    Bitmap, InputChunk, InputChunkKind, InputChunks, MmprojCaps, Mtmd, MtmdConfig, MtmdError,
    default_media_marker, probe_mmproj_caps,
};