inferno-ai 0.10.3

Enterprise AI/ML model runner with automatic updates, real-time monitoring, and multi-interface support
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24

//! # AI/ML Specialized Features
//!
//! This module contains AI/ML-specific features:
//! - Model format conversion
//! - Performance optimization
//! - Multimodal support (vision, audio)
//! - Real-time streaming
//! - GPU management
//!
//! AI features provide specialized capabilities for model execution and optimization.

// Re-export from existing locations for now
pub use crate::conversion;
pub use crate::gpu;
pub use crate::multimodal;

// Optimization consolidation
pub mod optimization;

// Sampling strategies and configuration
pub mod sampling;

// Real-time token streaming with channels
pub mod streaming;