Skip to main content

ENRICH_MAX_LENGTH_RETRIES

Constant ENRICH_MAX_LENGTH_RETRIES 

Source
pub const ENRICH_MAX_LENGTH_RETRIES: u32 = 2;
Expand description

Maximum number of max_tokens-growth re-attempts after a truncated (finish_reason: "length") enrich chat-completion, before giving up and returning the truncation as an error (GAP-SG-70/71).