Struct LengthBasedExampleSelector 

pub struct LengthBasedExampleSelector<E> { /* private fields */ }

Greedy: include each example in order until adding the next would exceed the configured max_tokens budget. The input itself is counted against the budget so callers know how much head-room is left for completion.

Implementations

impl<E> LengthBasedExampleSelector<E>

where E: Send + Sync + 'static,

pub fn new<F>( max_tokens: usize, tokenizer: Arc<dyn Tokenizer>, render: F, ) -> Self

where F: Fn(&E) -> String + Send + Sync + 'static,

Build a length-budgeted selector.

render converts an example to the text that will be substituted into the prompt — used by the tokenizer to size each example.

pub fn with_render<F>(self, render: F) -> Self

where F: Fn(&E) -> String + Send + Sync + 'static,

Replace the render function (e.g. when the prompt template changes).

pub fn with_tokenizer(self, tokenizer: Arc<dyn Tokenizer>) -> Self

Replace the tokenizer (e.g. swap CharTokenizer for tiktoken).

Trait Implementations

impl<E: Clone> Clone for LengthBasedExampleSelector<E>

fn clone(&self) -> LengthBasedExampleSelector<E>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<E> Debug for LengthBasedExampleSelector<E>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<E> ExampleSelector<E> for LengthBasedExampleSelector<E>

where E: Clone + Send + Sync + 'static,

fn select(&self, input: &str, examples: &[E]) -> Result<Vec<E>>

Select examples from examples to include for input. Returns owned clones (or constructs new examples) so the caller doesn’t have to manage lifetimes against the pool.