Expand description
Decision Engine configuration
Structsยง
- Batching
Config - Batching strategy configuration
- Caching
Config - Caching strategy configuration
- Decision
Engine Config - Configuration for the Decision Engine
- Model
Selection Config - Model selection strategy configuration
- Monitoring
Config - Monitoring configuration
- Prompt
Optimization Config - Prompt optimization strategy configuration
- Rate
Limiting Config - Rate limiting strategy configuration
- Safety
Config - Safety configuration
- Strategy
Configs - Configuration for all strategies