pub struct LlmModelCost {
pub input: f64,
pub output: f64,
pub cache_read: Option<f64>,
pub cost_tiers: Vec<CostTier>,
}Expand description
Cost information for the model (per million tokens)
Fields§
§input: f64Input cost per million tokens (USD)
output: f64Output cost per million tokens (USD)
cache_read: Option<f64>Cached read cost per million tokens (USD), if supported
cost_tiers: Vec<CostTier>Tiered pricing that applies above certain context thresholds. When present, the base cost fields apply up to the tier threshold, and each tier’s costs apply for tokens beyond that threshold.
Trait Implementations§
Source§impl Clone for LlmModelCost
impl Clone for LlmModelCost
Source§fn clone(&self) -> LlmModelCost
fn clone(&self) -> LlmModelCost
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LlmModelCost
impl Debug for LlmModelCost
Source§impl<'de> Deserialize<'de> for LlmModelCost
impl<'de> Deserialize<'de> for LlmModelCost
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for LlmModelCost
impl RefUnwindSafe for LlmModelCost
impl Send for LlmModelCost
impl Sync for LlmModelCost
impl Unpin for LlmModelCost
impl UnsafeUnpin for LlmModelCost
impl UnwindSafe for LlmModelCost
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request