Expand description
Context Window Management
Automatic token counting and context truncation. Prevents silent failures when prompts exceed model context limits.
Structs§
- Context
Config - Context management configuration
- Context
Manager - Context manager for handling token limits
- Context
Window - Known model context window sizes
- Token
Estimator - Simple token estimator (approximation without full tokenizer)
Enums§
- Context
Error - Context management errors
- Truncation
Strategy - Truncation strategy when context is exceeded