Expand description
Attention zone layout and scored memory ranking. Attention-aware context layout using U-curve optimization.
LLMs attend best to content at the START and END of context, with degradation in the middle. This module arranges memories to exploit that attention pattern.
Structs§
- Context
Block - A block of memories assigned to a specific attention zone.
- Context
Layout - Arranges memories into attention zones following the U-curve pattern.
- Scored
Memory - A memory with an associated relevance score.
- Zone
Thresholds - Thresholds for classifying memories into attention zones.
Enums§
- Attention
Zone - Attention zones based on U-curve optimization.