Expand description
Configuration types for Ferrum components
Structs§
- Backend
Config - Backend configuration
- Batch
Config - Engine
Config - Engine configuration
- Engine
Model Config - KvCache
Config - KV Cache configuration
- Memory
Config - Memory management configuration
- Monitoring
Config - Padding
Config - Padding configuration
- Sampling
Config - Scheduler
Config - Scheduler configuration
- Security
Config - Sampling configuration presets Security configuration
- Tokenizer
Config - Tokenizer configuration
- Truncation
Config - Truncation configuration
Enums§
- Backend
Type - Supported backend types
- KvCache
Type - KV Cache implementation types
- Padding
Strategy - Padding strategies
- Scheduling
Policy - Scheduling policies
- Tokenizer
Type - Tokenizer algorithms
- Truncation
Strategy - Truncation strategies