pub enum CachePoint {
Tools,
System,
Messages(usize),
Within {
message: usize,
items: usize,
},
}Expand description
A point in a CompletionRequest that ends a stable prefix, for
CompletionRequest::cache_points. Prefixes run in the order a request
is sent: tools, then the system prompt, then the messages.
Variants§
Tools
After the tool definitions.
System
After the system prompt.
Messages(usize)
After the first n user and assistant messages. System messages
are not counted, wherever they sit; Messages(0) is Self::System.
The point names the request’s messages as written: adapting them
for a wire, which drops some and joins adjacent user messages, moves
the point with them, inside a joined message when it ends there.
Within
After the first items content items of the user or assistant
message at message, counted as Self::Messages counts them.
Trait Implementations§
Source§impl Clone for CachePoint
impl Clone for CachePoint
Source§fn clone(&self) -> CachePoint
fn clone(&self) -> CachePoint
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for CachePoint
Source§impl Debug for CachePoint
impl Debug for CachePoint
Source§impl<'de> Deserialize<'de> for CachePoint
impl<'de> Deserialize<'de> for CachePoint
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<CachePoint, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<CachePoint, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for CachePoint
Source§impl Hash for CachePoint
impl Hash for CachePoint
Source§impl PartialEq for CachePoint
impl PartialEq for CachePoint
Source§impl Serialize for CachePoint
impl Serialize for CachePoint
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl StructuralPartialEq for CachePoint
Auto Trait Implementations§
impl Freeze for CachePoint
impl RefUnwindSafe for CachePoint
impl Send for CachePoint
impl Sync for CachePoint
impl Unpin for CachePoint
impl UnsafeUnpin for CachePoint
impl UnwindSafe for CachePoint
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
Source§fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
Convert this value without routing structured data through a string.