Skip to main content

Module cache_aware

Module cache_aware 

Source

Functionsยง

sort_tool_definitions
Sort tool definitions with priority grouping to improve LLM attention. Priority tools appear first (better attention), then alphabetically. This can save ~50-100 tokens per request via improved LLM focus.