Struct BoxedStrategy 

pub struct BoxedStrategy(/* private fields */);

A type-erased wrapper around a ContextStrategy for use in CompositeStrategy.

Use BoxedStrategy::new(strategy) to wrap any strategy.

Example

use neuron_context::{SlidingWindowStrategy, strategies::BoxedStrategy};

let boxed = BoxedStrategy::new(SlidingWindowStrategy::new(10, 100_000));

Implementations

impl BoxedStrategy

pub fn new<S: ContextStrategy + 'static>(strategy: S) -> Self

Wrap any ContextStrategy into a type-erased BoxedStrategy.

Trait Implementations

impl ContextStrategy for BoxedStrategy

fn should_compact(&self, messages: &[Message], token_count: usize) -> bool

Whether compaction should be triggered given the current messages and token count.

fn compact( &self, messages: Vec<Message>, ) -> impl Future<Output = Result<Vec<Message>, ContextError>> + WasmCompatSend

Compact the message list to reduce token usage.

fn token_estimate(&self, messages: &[Message]) -> usize

Estimate the token count for a list of messages.