sync_validate_request_size

Function sync_validate_request_size 

Source
pub fn sync_validate_request_size(
    request: &ChatCompletionRequest,
    max_tokens: usize,
) -> Result<()>
Expand description

Synchronous wrapper for validate_request_size (requires count_tokens feature).

Validates that a request fits within the model’s context window.

§Arguments

  • request - The chat completion request
  • max_tokens - The model’s maximum context window size

§Returns

Ok(()) if the request fits, error otherwise.

§Errors

Returns XaiError::InvalidParameter if the request exceeds the context window.

§Examples

use api_xai::{ sync_validate_request_size, ChatCompletionRequest, Message };

let request = ChatCompletionRequest::former()
  .model( "grok-2-1212".to_string() )
  .messages( vec![ Message::user( "Hello!" ) ] )
  .form();

// Grok-3 has 131K context window
sync_validate_request_size( &request, 131072 )?;