Expand description
Unified Inference Runtime for Zeta Reticula
This module consolidates inference functionality from:
- zeta-infer/
- zeta-integration/
- ns-router-rs/src/inference.rs
- llm-rs inference components
Structs§
- Cache
Stats - Inference
Request - Inference
Response - Unified
Inference Engine - Unified Inference Engine
Functions§
- create_
inference_ engine - Factory function for creating inference engines
- infer
- Convenience function for single inference