pub struct PromptCacheBreakpointConfig {
pub mode: PromptCacheBreakpointConfigMode,
pub ttl: Option<PromptCacheBreakpointTTLEnum>,
}Available on crate feature
response-types only.Expand description
Marks the exact end of a reusable prompt prefix. When ttl is omitted, the breakpoint inherits the request TTL. The boundary is not rounded to a token block.
Fields§
§mode: PromptCacheBreakpointConfigModeThe breakpoint mode. Always explicit.
ttl: Option<PromptCacheBreakpointTTLEnum>The minimum lifetime of this cache breakpoint. Defaults to the request TTL.
Trait Implementations§
Source§impl Clone for PromptCacheBreakpointConfig
impl Clone for PromptCacheBreakpointConfig
Source§impl Debug for PromptCacheBreakpointConfig
impl Debug for PromptCacheBreakpointConfig
Source§impl<'de> Deserialize<'de> for PromptCacheBreakpointConfig
impl<'de> Deserialize<'de> for PromptCacheBreakpointConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for PromptCacheBreakpointConfig
Auto Trait Implementations§
impl Freeze for PromptCacheBreakpointConfig
impl RefUnwindSafe for PromptCacheBreakpointConfig
impl Send for PromptCacheBreakpointConfig
impl Sync for PromptCacheBreakpointConfig
impl Unpin for PromptCacheBreakpointConfig
impl UnsafeUnpin for PromptCacheBreakpointConfig
impl UnwindSafe for PromptCacheBreakpointConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more