Skip to main content

parse_prompt_too_long_gap

Function parse_prompt_too_long_gap 

Source
pub fn parse_prompt_too_long_gap(error_text: &str) -> Option<u64>
Expand description

Parse a “prompt too long” error to extract the token gap.

Looks for patterns like “prompt is too long: 137500 tokens > 135000 maximum” and returns the difference (2500 in this example).