pub struct PromptCacheBreakpoint {
pub mode: PromptCacheBreakpointMode,
}Available on crate feature
decision-types only.Expand description
Marks the exact end of a reusable prompt prefix. The breakpoint inherits its TTL from the request’s prompt_cache_options.ttl; the boundary is not rounded to a token block.
Fields§
§mode: PromptCacheBreakpointModeThe breakpoint mode. Always explicit.
Trait Implementations§
Source§impl Clone for PromptCacheBreakpoint
impl Clone for PromptCacheBreakpoint
Source§impl Debug for PromptCacheBreakpoint
impl Debug for PromptCacheBreakpoint
Source§impl Default for PromptCacheBreakpoint
impl Default for PromptCacheBreakpoint
Source§impl<'de> Deserialize<'de> for PromptCacheBreakpoint
impl<'de> Deserialize<'de> for PromptCacheBreakpoint
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for PromptCacheBreakpoint
impl PartialEq for PromptCacheBreakpoint
Source§impl Serialize for PromptCacheBreakpoint
impl Serialize for PromptCacheBreakpoint
impl StructuralPartialEq for PromptCacheBreakpoint
Auto Trait Implementations§
impl Freeze for PromptCacheBreakpoint
impl RefUnwindSafe for PromptCacheBreakpoint
impl Send for PromptCacheBreakpoint
impl Sync for PromptCacheBreakpoint
impl Unpin for PromptCacheBreakpoint
impl UnsafeUnpin for PromptCacheBreakpoint
impl UnwindSafe for PromptCacheBreakpoint
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more