Skip to main content

execute_token_count_request

Function execute_token_count_request 

Source
pub async fn execute_token_count_request(
    request_builder: RequestBuilder,
    payload: &Value,
    provider_name: &str,
) -> Result<Option<Value>, LLMError>
Expand description

Execute an exact token-count request when provider endpoint is available. Returns Ok(None) when endpoint appears unsupported.