realizar 0.8.4

Pure Rust ML inference engine built from scratch - model serving for GGUF and safetensors
1
2
3
4
5
6
7
8
9
10
11
//! Forward pass implementations for OwnedQuantizedModel
//!
//! Contains forward, forward_cached methods.
//! These are the core inference entry points.

use crate::brick::BrickProfiler;
use crate::error::Result;
use crate::gguf::ops;
use crate::gguf::OwnedQuantizedModel;

include!("forward_cached.rs");