pub enum TokenRateSchedule {
PromptTokenThreshold {
applies_to: RateScheduleApplication,
tiers: Vec<TokenRateTier>,
},
}Expand description
Data-driven token rate schedule for model pricing with request thresholds.
Variants§
PromptTokenThreshold
Selects one full-request rate tier based on prompt/input tokens.
Fields
§
applies_to: RateScheduleApplicationHow selected tier rates apply to tokens.
§
tiers: Vec<TokenRateTier>Ordered threshold tiers.
Trait Implementations§
Source§impl Clone for TokenRateSchedule
impl Clone for TokenRateSchedule
Source§fn clone(&self) -> TokenRateSchedule
fn clone(&self) -> TokenRateSchedule
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TokenRateSchedule
impl Debug for TokenRateSchedule
Source§impl<'de> Deserialize<'de> for TokenRateSchedule
impl<'de> Deserialize<'de> for TokenRateSchedule
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for TokenRateSchedule
impl PartialEq for TokenRateSchedule
Source§impl Serialize for TokenRateSchedule
impl Serialize for TokenRateSchedule
impl StructuralPartialEq for TokenRateSchedule
Auto Trait Implementations§
impl Freeze for TokenRateSchedule
impl RefUnwindSafe for TokenRateSchedule
impl Send for TokenRateSchedule
impl Sync for TokenRateSchedule
impl Unpin for TokenRateSchedule
impl UnsafeUnpin for TokenRateSchedule
impl UnwindSafe for TokenRateSchedule
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
Source§fn with_current_context(self) -> WithContext<Self> ⓘ
fn with_current_context(self) -> WithContext<Self> ⓘ
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request