Skip to main content

record_llm_usage

Function record_llm_usage 

Source
pub fn record_llm_usage(
    prompt_tokens: usize,
    completion_tokens: usize,
    total_tokens: usize,
    stop_reason: Option<&str>,
)
Expand description

Record LLM token usage on the current span