Skip to main content

COMPRESS_MAX_TOKENS

matrixcode_core::constants

Constant COMPRESS_MAX_TOKENS 

Source 
pub const COMPRESS_MAX_TOKENS: u32 = 1024;
Expand description

Max tokens for compress role (shorter output)