pub struct SerializationIntent {
pub fanout_width: u32,
pub expected_savings_tokens: u64,
pub reuse_probability: f64,
pub added_latency_ms: Option<f64>,
pub scope_label: SharingScope,
}Expand description
Serialization and fanout optimization intent.
Indicates that a prompt region is reused across multiple parallel requests and can benefit from serialized (shared) caching.
Fields§
§fanout_width: u32Number of parallel requests sharing this content.
expected_savings_tokens: u64Expected token savings from caching.
reuse_probability: f64Probability that the cached content will be reused [0.0, 1.0].
added_latency_ms: Option<f64>Additional latency introduced by the serialization strategy.
scope_label: SharingScopeSharing scope for the serialized content.
Trait Implementations§
Source§impl Clone for SerializationIntent
impl Clone for SerializationIntent
Source§fn clone(&self) -> SerializationIntent
fn clone(&self) -> SerializationIntent
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for SerializationIntent
impl Debug for SerializationIntent
Source§impl<'de> Deserialize<'de> for SerializationIntent
impl<'de> Deserialize<'de> for SerializationIntent
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for SerializationIntent
impl PartialEq for SerializationIntent
Source§fn eq(&self, other: &SerializationIntent) -> bool
fn eq(&self, other: &SerializationIntent) -> bool
Tests for
self and other values to be equal, and is used by ==.Source§impl Serialize for SerializationIntent
impl Serialize for SerializationIntent
impl StructuralPartialEq for SerializationIntent
Auto Trait Implementations§
impl Freeze for SerializationIntent
impl RefUnwindSafe for SerializationIntent
impl Send for SerializationIntent
impl Sync for SerializationIntent
impl Unpin for SerializationIntent
impl UnsafeUnpin for SerializationIntent
impl UnwindSafe for SerializationIntent
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more