pub struct ModelSelectionStrategy { /* private fields */ }Expand description
Model Selection Strategy
This strategy evaluates different LLM models based on:
- Cost: Token cost and total daily cost
- Performance: Latency (P50, P95, P99)
- Quality: User ratings and success rates
It uses Pareto optimization to find models that are optimal for at least one objective while not being dominated by other models in all objectives.
Implementations§
Source§impl ModelSelectionStrategy
impl ModelSelectionStrategy
Sourcepub fn new(config: ModelSelectionConfig) -> Self
pub fn new(config: ModelSelectionConfig) -> Self
Create a new model selection strategy
Trait Implementations§
Source§impl Debug for ModelSelectionStrategy
impl Debug for ModelSelectionStrategy
Source§impl OptimizationStrategy for ModelSelectionStrategy
impl OptimizationStrategy for ModelSelectionStrategy
Source§fn is_applicable(&self, input: &DecisionInput) -> bool
fn is_applicable(&self, input: &DecisionInput) -> bool
Check if this strategy is applicable to the given input
Source§fn evaluate<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
input: &'life1 DecisionInput,
criteria: &'life2 DecisionCriteria,
) -> Pin<Box<dyn Future<Output = DecisionResult<Vec<Decision>>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
fn evaluate<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
input: &'life1 DecisionInput,
criteria: &'life2 DecisionCriteria,
) -> Pin<Box<dyn Future<Output = DecisionResult<Vec<Decision>>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
Evaluate and generate decisions Read more
Source§fn validate<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
decision: &'life1 Decision,
criteria: &'life2 DecisionCriteria,
) -> Pin<Box<dyn Future<Output = DecisionResult<()>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
fn validate<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
decision: &'life1 Decision,
criteria: &'life2 DecisionCriteria,
) -> Pin<Box<dyn Future<Output = DecisionResult<()>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
Validate a decision before execution Read more
Source§fn learn<'life0, 'life1, 'life2, 'async_trait>(
&'life0 mut self,
decision: &'life1 Decision,
outcome: &'life2 DecisionOutcome,
) -> Pin<Box<dyn Future<Output = DecisionResult<()>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
fn learn<'life0, 'life1, 'life2, 'async_trait>(
&'life0 mut self,
decision: &'life1 Decision,
outcome: &'life2 DecisionOutcome,
) -> Pin<Box<dyn Future<Output = DecisionResult<()>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
Learn from a decision outcome Read more
Auto Trait Implementations§
impl Freeze for ModelSelectionStrategy
impl RefUnwindSafe for ModelSelectionStrategy
impl Send for ModelSelectionStrategy
impl Sync for ModelSelectionStrategy
impl Unpin for ModelSelectionStrategy
impl UnsafeUnpin for ModelSelectionStrategy
impl UnwindSafe for ModelSelectionStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
Source§fn with_current_context(self) -> WithContext<Self> ⓘ
fn with_current_context(self) -> WithContext<Self> ⓘ
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::RequestSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.