Struct JsonSizeTokenMeter 

pub struct JsonSizeTokenMeter { /* private fields */ }

Implementations

impl JsonSizeTokenMeter

pub fn new(bytes_per_token: u64) -> Result<Self, SessionContextError>

Trait Implementations

impl Default for JsonSizeTokenMeter

fn default() -> Self

Returns the “default value” for a type.

impl ModelTokenMeter for JsonSizeTokenMeter

fn meter_descriptor(&self) -> ModelTokenMeterDescriptor

fn count_request_input( &self, messages: &[ModelMessage], tools: &[ModelToolDefinition], ) -> Result<u64, ModelError>

fn supports_observed_prefix_estimation(&self) -> bool

Whether differences between this meter’s soft estimates may be added to observed input usage for an unchanged request prefix. This remains estimated accounting, never a hard bound. Opting in must change the meter descriptor’s immutable identity; unknown meters retain full-input estimation. The runtime separately verifies the prefix and Run scope.

fn estimate_context_input( &self, messages: &[ModelMessage], tools: &[ModelToolDefinition], ) -> Result<ModelContextEstimate, ModelError>

Estimate space for context selection when no hard input/cost ceiling applies. The default retains the existing certified count. Adapters overriding this method must bind its algorithm into their descriptor’s immutable identity. Estimates must not replace count_request_input for resource reservations or validation of observed usage.