mistralrs 0.8.1

Fast, flexible LLM inference.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
//! Low-level types and internals re-exported from `mistralrs_core`.
//!
//! Most users don't need these types directly. They're available for advanced
//! use cases like custom pipelines, device mapping, or direct engine access.
//!
//! # When to use this module
//!
//! - Building custom loaders or pipelines
//! - Accessing diagnostic/doctor utilities
//! - Using auto-tuning features
//! - Direct engine manipulation
//!
//! For typical inference tasks, use the types exported at the crate root.

pub use mistralrs_core::*;