Expand description
Core type definitions for the Ferrum inference framework
This crate contains all the fundamental types, IDs, configurations, and error definitions that are shared across the entire Ferrum ecosystem. It is designed to be lightweight and dependency-free to avoid circular dependencies.
Re-exports§
pub use auto_config::*;pub use config::*;pub use devices::*;pub use errors::*;pub use ids::*;pub use metrics::*;pub use models::*;pub use requests::*;pub use runtime_config::*;pub use sampling::*;
Modules§
- auto_
config - Startup auto-configuration and selector decision trace types.
- config
- Configuration types for Ferrum components
- devices
- Device and computation types
- errors
- Error types for Ferrum inference framework
- ids
- Identifier types for Ferrum entities
- metrics
- Metrics and observability types
- models
- Model-related types and configurations
- requests
- Request and response types for inference
- runtime_
config - Runtime configuration snapshot and small env parsing helpers.
- sampling
- Sampling and generation parameters