pub struct CacheEconomics {
pub write_short_multiplier: f64,
pub write_long_multiplier: Option<f64>,
pub read_multiplier: f64,
}Expand description
Provider/model-specific cache economics used by the internal planner.
These values are kept on the capability surface so the core planner can stay provider-agnostic while concrete plugins/model families supply the pricing model that makes a cache write profitable.
Fields§
§write_short_multiplier: f64Input cost multiplier for creating a short-lived cache entry.
write_long_multiplier: Option<f64>Optional input cost multiplier for creating a longer-lived cache entry.
read_multiplier: f64Input cost multiplier for reading from cache.
Trait Implementations§
Source§impl Clone for CacheEconomics
impl Clone for CacheEconomics
Source§fn clone(&self) -> CacheEconomics
fn clone(&self) -> CacheEconomics
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CacheEconomics
impl Debug for CacheEconomics
Source§impl<'de> Deserialize<'de> for CacheEconomics
impl<'de> Deserialize<'de> for CacheEconomics
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for CacheEconomics
impl PartialEq for CacheEconomics
Source§fn eq(&self, other: &CacheEconomics) -> bool
fn eq(&self, other: &CacheEconomics) -> bool
Tests for
self and other values to be equal, and is used by ==.Source§impl Serialize for CacheEconomics
impl Serialize for CacheEconomics
impl StructuralPartialEq for CacheEconomics
Auto Trait Implementations§
impl Freeze for CacheEconomics
impl RefUnwindSafe for CacheEconomics
impl Send for CacheEconomics
impl Sync for CacheEconomics
impl Unpin for CacheEconomics
impl UnsafeUnpin for CacheEconomics
impl UnwindSafe for CacheEconomics
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more