Struct ResponsesHistoryCache 

pub struct ResponsesHistoryCache(/* private fields */);

Connection-owned cache for store=false Responses continuation. Clone this handle only within one client connection; dropping all handles loses its cached content. No cache entries are written to StateStore for store=false.

Implementations

impl ResponsesHistoryCache

pub fn new(max_entries: usize, max_bytes: usize) -> Self

pub async fn expand<S: StateStore>( &self, request: &GenerateContentRequestBody, state: &GenerationStateAccess<'_, S>, limits: CodecLimits, ) -> Result<GenerateContentRequestBody, TransformError>

Expand a Responses request for a connection-owned orchestration layer. No generation is sent and previous instructions are not inherited.

pub async fn save_transcript<S: StateStore>( &self, response_id: &str, input: Vec<InputItem>, store: bool, state: &GenerationStateAccess<'_, S>, limits: CodecLimits, ) -> Result<(), TransformError>

Save the actual ordered transcript of a gateway response. This also supports warmup and interrupted responses without inventing a native generation or duplicating the output of earlier HTTP segments.

Trait Implementations

impl Clone for ResponsesHistoryCache

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.