Skip to main content

request_estimate

Function request_estimate 

Source
pub fn request_estimate(request: &CompletionRequest) -> u64
Expand description

The estimate of a request sent as it is: its messages and tools, by the default HeuristicTokenCounter. Its documents are not counted.

use rig_core::completion::{CompletionRequest, Message};
use rig_memory::request_estimate;

let request = CompletionRequest::new(Message::user("12345678"));
assert_eq!(request_estimate(&request), 2 + 4);