Expand description
§Infernum Core
Core types and traits for the Infernum ecosystem.
This crate provides the foundational abstractions used across all Infernum components:
- Common error types
- Request/response structures
- Model metadata and configuration
- Shared traits for inference, embedding, and streaming
Re-exports§
pub use error::Error;pub use error::Result;pub use model::ModelArchitecture;pub use model::ModelMetadata;pub use model::ModelSource;pub use request::EmbedRequest;pub use request::GenerateRequest;pub use request::PromptInput;pub use response::EmbedResponse;pub use response::GenerateResponse;pub use response::TokenInfo;pub use sampling::SamplingParams;pub use streaming::TokenStream;pub use types::*;
Modules§
- error
- Error types for the Infernum ecosystem.
- model
- Model metadata and architecture types.
- request
- Request types for inference operations.
- response
- Response types for inference operations.
- sampling
- Sampling parameters for text generation.
- streaming
- Streaming types for real-time token generation.
- types
- Common types used across the Infernum ecosystem.