Crate infernum_core

Crate infernum_core 

Source
Expand description

§Infernum Core

Core types and traits for the Infernum ecosystem.

This crate provides the foundational abstractions used across all Infernum components:

  • Common error types
  • Request/response structures
  • Model metadata and configuration
  • Shared traits for inference, embedding, and streaming

Re-exports§

pub use error::Error;
pub use error::Result;
pub use model::ModelArchitecture;
pub use model::ModelMetadata;
pub use model::ModelSource;
pub use request::EmbedRequest;
pub use request::GenerateRequest;
pub use request::PromptInput;
pub use response::EmbedResponse;
pub use response::GenerateResponse;
pub use response::TokenInfo;
pub use sampling::SamplingParams;
pub use streaming::TokenStream;
pub use types::*;

Modules§

error
Error types for the Infernum ecosystem.
model
Model metadata and architecture types.
request
Request types for inference operations.
response
Response types for inference operations.
sampling
Sampling parameters for text generation.
streaming
Streaming types for real-time token generation.
types
Common types used across the Infernum ecosystem.