Struct Summarizer 

pub struct Summarizer {
    pub prompts: SummaryPrompts,
    pub limits: SummaryLimits,
}

Builds the request for a summary of a conversation’s older messages and reads the summary from the model’s answer. The conversation goes as text in one user message, so the model reads it rather than continues it.

Fields

prompts: SummaryPrompts

What the model is asked.

limits: SummaryLimits

Sizes.

Implementations

impl Summarizer

pub const DEFAULT: Self

SummaryPrompts::DEFAULT within SummaryLimits::DEFAULT.

impl Summarizer

pub fn request( &self, older: &[Arc<Message>], previous: &str, focus: &str, spec: &ModelSpec, ) -> Result<CompletionRequest, UnsupportedOption>

The request to spec for a summary of older, merged into previous when that is not empty. focus is what the summary should keep above all; it may be empty.

pub fn max_tokens(&self, spec: &ModelSpec) -> u64

The longest summary asked of spec: the limit’s, or the model’s output limit when that is lower.

pub fn instruction(&self, focus: &str) -> String

The message that asks for a summary at the end of the conversation itself, the agent’s own request with its system prompt and tools cut before the first message kept, so the provider can read all of it from its prompt cache: SummaryPrompts::in_place, focus when it is not empty, and the format.

pub fn summary_text( response: &CompletionResponse, ) -> Result<String, SummaryError>

The summary in a finished answer, or why it cannot be used.

Trait Implementations

impl Clone for Summarizer

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Summarizer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Summarizer

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for Summarizer

where Summarizer: Default,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for Summarizer

impl PartialEq for Summarizer

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for Summarizer

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Summarizer