Enum TokenCountStrategy 

pub enum TokenCountStrategy {
    CharApprox,
    WhitespaceSplit,
    CharDiv4,
}

Token 计数策略（简化版）

Variants

CharApprox

按字符数估算（中文1字≈1.5 token，英文约4字符≈1 token）

WhitespaceSplit

按空格分词估算（粗略）

CharDiv4

简单字符数 / 4

Trait Implementations

impl Clone for TokenCountStrategy

fn clone(&self) -> TokenCountStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenCountStrategy

impl Debug for TokenCountStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TokenCountStrategy

fn default() -> TokenCountStrategy

Returns the “default value” for a type.

impl Eq for TokenCountStrategy

impl PartialEq for TokenCountStrategy

fn eq(&self, other: &TokenCountStrategy) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TokenCountStrategy