Skip to main content

DEFAULT_MAX_TOKENS

Constant DEFAULT_MAX_TOKENS 

Source
pub const DEFAULT_MAX_TOKENS: u32 = 1024;
Expand description

Default max_tokens. SQL generation rarely needs more than ~500 output tokens (single-statement queries + a one-sentence explanation). 1024 leaves headroom; under the SDK timeout cap so we don’t have to stream.