Expand description
Decision Engine Module
This module provides the decision-making capabilities for the LLM Auto-Optimizer. It includes various optimization strategies and a coordinator to manage them.
Re-exports§
pub use config::BatchingConfig;pub use config::CachingConfig;pub use config::DecisionEngineConfig;pub use config::ModelSelectionConfig;pub use config::MonitoringConfig;pub use config::PromptOptimizationConfig;pub use config::RateLimitingConfig;pub use config::SafetyConfig;pub use config::StrategyConfigs;pub use batching::BatchingStrategy;pub use caching::CachingStrategy;pub use coordinator::DecisionCoordinator;pub use error::DecisionError;pub use error::DecisionResult;pub use error::DecisionState;pub use model_selection::ModelSelectionStrategy;pub use prompt_optimization::PromptOptimizationStrategy;pub use rate_limiting::RateLimitingStrategy;pub use traits::DecisionEngine;pub use traits::DecisionExecutor;pub use traits::DecisionValidator;pub use traits::OptimizationStrategy;pub use types::ActualImpact;pub use types::ComparisonOperator;pub use types::ConfigChange;pub use types::ConfigType;pub use types::Decision;pub use types::DecisionCriteria;pub use types::DecisionInput;pub use types::DecisionOutcome;pub use types::DecisionStats;pub use types::DecisionType;pub use types::ExpectedImpact;pub use types::RollbackCondition;pub use types::RollbackPlan;pub use types::SafetyCheck;pub use types::SystemMetrics;
Modules§
- batching
- Request Batching Strategy
- caching
- Caching Strategy for the Decision Engine
- config
- Decision Engine configuration
- coordinator
- Decision Engine Coordinator
- error
- Decision Engine error types
- model_
selection - Model Selection Strategy
- prompt_
optimization - Prompt Optimization Strategy
- rate_
limiting - Rate Limiting Strategy
- traits
- Decision Engine core traits
- types
- Decision Engine core types