Expand description
Core type definitions for the Ferrum inference framework
This crate contains all the fundamental types, IDs, configurations, and error definitions that are shared across the entire Ferrum ecosystem. It is designed to be lightweight and dependency-free to avoid circular dependencies.
Re-exports§
pub use config::*;pub use devices::*;pub use errors::*;pub use ids::*;pub use metrics::*;pub use models::*;pub use requests::*;pub use sampling::*;
Modules§
- config
- Configuration types for Ferrum components
- devices
- Device and computation types
- errors
- Error types for Ferrum inference framework
- ids
- Identifier types for Ferrum entities
- metrics
- Metrics and observability types
- models
- Model-related types and configurations
- requests
- Request and response types for inference
- sampling
- Sampling and generation parameters