Struct Summarizer 

pub struct Summarizer<'a> {
    pub model: &'a Model,
    pub apis: Apis,
    pub auth: Auth,
    pub thinking_level: ThinkingLevel,
    pub retry: RetryPolicy,
    pub request: Result<StreamOptions, String>,
    pub cancel: CancellationToken,
    pub on_retry: Box<dyn Fn(SummaryRetry) + Send + Sync + 'a>,
    pub hooks: RequestHooks,
}

What summary requests need besides the messages.

Fields

model: &'a Model

The model to summarize with.

apis: Apis

Wire APIs.

auth: Auth

Credentials for the model.

thinking_level: ThinkingLevel

The session’s thinking level, used when the model reasons.

retry: RetryPolicy

Retries for transient failures.

request: Result<StreamOptions, String>

The settings every request carries, as the session’s requests carry them, or the error an invalid one raises.

cancel: CancellationToken

Cancels the requests.

on_retry: Box<dyn Fn(SummaryRetry) + Send + Sync + 'a>

Hears about retries.

hooks: RequestHooks

Observers of the requests.

Implementations

impl Summarizer<'_>

pub async fn generate_summary( &self, messages: &[Message], reserve_tokens: u64, custom_instructions: Option<&str>, previous: Option<&str>, ) -> Result<Summary, String>

Summarizes messages, updating previous when given.

pub async fn compact( &self, preparation: &Preparation, custom_instructions: Option<&str>, ) -> Result<CompactionResult, String>

Generates the compaction summary for a preparation.

impl Summarizer<'_>

pub async fn branch_summary( &self, entries: &[FileEntry], custom_instructions: Option<&str>, replace: bool, reserve_tokens: u64, ) -> Result<BranchSummary, String>

Summarizes abandoned branch entries (chronological). replace makes custom_instructions the whole instruction instead of an addition.