pub fn sync_validate_request_size(
request: &ChatCompletionRequest,
max_tokens: usize,
) -> Result<()>Expand description
Synchronous wrapper for validate_request_size (requires count_tokens feature).
Validates that a request fits within the model’s context window.
§Arguments
request- The chat completion requestmax_tokens- The model’s maximum context window size
§Returns
Ok(()) if the request fits, error otherwise.
§Errors
Returns XaiError::InvalidParameter if the request exceeds the context window.
§Examples
use api_xai::{ sync_validate_request_size, ChatCompletionRequest, Message };
let request = ChatCompletionRequest::former()
.model( "grok-2-1212".to_string() )
.messages( vec![ Message::user( "Hello!" ) ] )
.form();
// Grok-3 has 131K context window
sync_validate_request_size( &request, 131072 )?;