pub struct PromptAssembled {
pub segments: Vec<PromptSegment>,
pub breakpoints: Vec<String>,
}Expand description
prompt_assembled: the four segments a request was built from, and
the cache breakpoints it carried.
This is the line an offline rebuild reads (A15): every segment says which documents went into it and how much of each one survived the slot’s byte cap, so the bytes the model read can be reconstructed from the files without the request being kept.
Fields§
§segments: Vec<PromptSegment>§breakpoints: Vec<String>The explicit cache breakpoints the request carried, in request
order: a slot name for a segment edge, tail for the last
message. The plan has one author, runtime::prefix::BreakpointPlan,
and this key carries what that author printed. A ledger written
before the plan existed holds the four slot names here instead.
Trait Implementations§
Source§impl Clone for PromptAssembled
impl Clone for PromptAssembled
Source§impl Debug for PromptAssembled
impl Debug for PromptAssembled
Source§impl Default for PromptAssembled
impl Default for PromptAssembled
Source§impl<'de> Deserialize<'de> for PromptAssembled
impl<'de> Deserialize<'de> for PromptAssembled
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for PromptAssembled
Source§impl PartialEq for PromptAssembled
impl PartialEq for PromptAssembled
Source§impl Serialize for PromptAssembled
impl Serialize for PromptAssembled
impl StructuralPartialEq for PromptAssembled
Auto Trait Implementations§
impl Freeze for PromptAssembled
impl RefUnwindSafe for PromptAssembled
impl Send for PromptAssembled
impl Sync for PromptAssembled
impl Unpin for PromptAssembled
impl UnsafeUnpin for PromptAssembled
impl UnwindSafe for PromptAssembled
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more