pub struct CacheRates {
pub input: f64,
pub cached_read: f64,
pub cache_write: f64,
pub storage_per_hour: f64,
}Expand description
Prices of one model and tier, in USD per 1M tokens (storage: per 1M
token-hours). The built-in catalog’s Pricing
holds the input, cached-read and cache-write prices of the models it
lists, but no storage price. A provider without a separate write price
bills writes at input; one without storage leaves storage_per_hour
at zero.
use rig_core::completion::CacheRates;
// A 5-minute cache write at 1.25 times the input price, reads at a tenth.
let rates = CacheRates { input: 3.0, cached_read: 0.3, cache_write: 3.75, storage_per_hour: 0.0 };Fields§
§input: f64Uncached input.
cached_read: f64Input read from a cache.
cache_write: f64Input written to a cache, or put into a cache resource.
storage_per_hour: f64Storing one token for one hour, for providers that bill cache storage.
Trait Implementations§
Source§impl Clone for CacheRates
impl Clone for CacheRates
Source§fn clone(&self) -> CacheRates
fn clone(&self) -> CacheRates
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for CacheRates
Source§impl Debug for CacheRates
impl Debug for CacheRates
Source§impl Default for CacheRates
impl Default for CacheRates
Source§fn default() -> CacheRates
fn default() -> CacheRates
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for CacheRates
impl<'de> Deserialize<'de> for CacheRates
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<CacheRates, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<CacheRates, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for CacheRates
impl PartialEq for CacheRates
Source§impl Serialize for CacheRates
impl Serialize for CacheRates
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl StructuralPartialEq for CacheRates
Auto Trait Implementations§
impl Freeze for CacheRates
impl RefUnwindSafe for CacheRates
impl Send for CacheRates
impl Sync for CacheRates
impl Unpin for CacheRates
impl UnsafeUnpin for CacheRates
impl UnwindSafe for CacheRates
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
Source§fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
Convert this value without routing structured data through a string.