Skip to main content

Module config

Module config 

Source

Structs§

ContextConfig
All compression and context management parameters expressed as fractions of max_tokens. This is the single control surface for the compression pipeline: changing max_tokens (e.g. switching model) rescales every derived limit automatically with no other configuration change required.