Skip to main content

messages_to_api_params_cached

Function messages_to_api_params_cached 

Source
pub fn messages_to_api_params_cached(messages: &[Message]) -> Vec<Value>
Expand description

Convert messages to API params with cache_control breakpoints.

Places an ephemeral cache marker on the last user message before the current turn, so the conversation prefix stays cached across the tool-call loop within a single turn.