Skip to main content

ENRICH_INITIAL_MAX_TOKENS

Constant ENRICH_INITIAL_MAX_TOKENS 

Source
pub const ENRICH_INITIAL_MAX_TOKENS: u32 = 4_096;
Expand description

Initial max_tokens budget sent on an enrich chat-completion request (GAP-SG-70/71).

Chosen well below ENRICH_MAX_TOKENS_CEILING so a well-formed response completes in one attempt for the common case; only bodies that need more room trigger the growth loop below.