pub struct TokenCounterAdapter(/* private fields */);Expand description
Adapter implementing zeph_context::summarization::MessageTokenCounter for
zeph_memory::TokenCounter.
Implementations§
Source§impl TokenCounterAdapter
impl TokenCounterAdapter
Sourcepub fn new(inner: Arc<TokenCounter>) -> Self
pub fn new(inner: Arc<TokenCounter>) -> Self
Wrap an Arc<TokenCounter> in the adapter.
Trait Implementations§
Source§impl MessageTokenCounter for TokenCounterAdapter
impl MessageTokenCounter for TokenCounterAdapter
Source§fn count_message_tokens(&self, msg: &Message) -> usize
fn count_message_tokens(&self, msg: &Message) -> usize
Return the token count for the given message, accounting for all parts.
Auto Trait Implementations§
impl Freeze for TokenCounterAdapter
impl !RefUnwindSafe for TokenCounterAdapter
impl Send for TokenCounterAdapter
impl Sync for TokenCounterAdapter
impl Unpin for TokenCounterAdapter
impl UnsafeUnpin for TokenCounterAdapter
impl !UnwindSafe for TokenCounterAdapter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request