List of all items
Structs
- InferenceConfig
- InferenceEngine
- InferenceResult
- adaptive_router::AdaptiveRouter
- adaptive_router::AdaptiveRoutingDecision
- adaptive_router::RoutingConfig
- backend::candle::CandleBackend
- backend::embedding::EmbeddingBackend
- backend::embedding::EmbeddingModelWeights
- backend::moe::Qwen3MoeModel
- hardware::HardwareInfo
- models::ModelInfo
- models::ModelRegistry
- outcome::InferenceOutcome
- outcome::ModelProfile
- outcome::OutcomeTracker
- outcome::TaskStats
- registry::ModelFilter
- registry::ModelInfo
- registry::UnifiedRegistry
- remote::RemoteBackend
- router::ModelRouter
- router::RoutingDecision
- schema::CostModel
- schema::ModelSchema
- schema::PerformanceEnvelope
- schema::ProprietaryProtocol
- tasks::classify::ClassifyRequest
- tasks::classify::ClassifyResult
- tasks::embed::EmbedRequest
- tasks::generate::GenerateParams
- tasks::generate::GenerateRequest
Enums
- Device
- InferenceError
- adaptive_router::RoutingStrategy
- adaptive_router::TaskComplexity
- hardware::GpuBackend
- models::ModelRole
- outcome::CodeOutcome
- outcome::InferenceTask
- outcome::InferredOutcome
- schema::ApiProtocol
- schema::ModelCapability
- schema::ModelSource
- schema::ProprietaryAuth
Functions
- backend::candle::to_candle_device_pub
- service::all_schemas
- service::classify_schema
- service::embed_schema
- service::execute_tool
- service::infer_grounded_schema
- service::infer_schema
- service::list_models_schema
- service::model_stats_schema
- service::route_model_schema
- tasks::classify::classify
- tasks::generate::generate
- tasks::generate::generate_with_retrieval
- tasks::generate::sample_token
- tasks::generate::sample_token_suppress
- tasks::generate::strip_thinking_pub