pub struct OpenAIPromptCacheSettings {
pub enabled: bool,
pub min_prefix_tokens: u32,
pub idle_expiration_seconds: u64,
pub surface_metrics: bool,
pub prompt_cache_key_mode: OpenAIPromptCacheKeyMode,
pub prompt_cache_retention: Option<String>,
}Expand description
OpenAI prompt caching controls (automatic with metrics)
Fields§
§enabled: bool§min_prefix_tokens: u32§idle_expiration_seconds: u64§surface_metrics: bool§prompt_cache_key_mode: OpenAIPromptCacheKeyModeStrategy for generating OpenAI prompt_cache_key.
Session mode derives one stable key per VT Code conversation.
prompt_cache_retention: Option<String>Optional prompt cache retention string to pass directly into OpenAI Responses API.
Supported values are “in_memory” and “24h”. If set, VT Code will include
prompt_cache_retention in the request body to extend the model-side prompt
caching window or request the explicit in-memory policy.
Implementations§
Trait Implementations§
Source§impl Clone for OpenAIPromptCacheSettings
impl Clone for OpenAIPromptCacheSettings
Source§fn clone(&self) -> OpenAIPromptCacheSettings
fn clone(&self) -> OpenAIPromptCacheSettings
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for OpenAIPromptCacheSettings
impl Debug for OpenAIPromptCacheSettings
Source§impl Default for OpenAIPromptCacheSettings
impl Default for OpenAIPromptCacheSettings
Source§impl<'de> Deserialize<'de> for OpenAIPromptCacheSettings
impl<'de> Deserialize<'de> for OpenAIPromptCacheSettings
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl JsonSchema for OpenAIPromptCacheSettings
impl JsonSchema for OpenAIPromptCacheSettings
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
Whether JSON Schemas generated for this type should be included directly in parent schemas,
rather than being re-used where possible using the
$ref keyword. Read moreAuto Trait Implementations§
impl Freeze for OpenAIPromptCacheSettings
impl RefUnwindSafe for OpenAIPromptCacheSettings
impl Send for OpenAIPromptCacheSettings
impl Sync for OpenAIPromptCacheSettings
impl Unpin for OpenAIPromptCacheSettings
impl UnsafeUnpin for OpenAIPromptCacheSettings
impl UnwindSafe for OpenAIPromptCacheSettings
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
Source§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Converts
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be
downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.Source§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Converts
Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further
downcast into Rc<ConcreteType> where ConcreteType implements Trait.Source§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Converts
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.Source§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Converts
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.Source§impl<T> DowncastSend for T
impl<T> DowncastSend for T
Source§impl<T> DowncastSync for T
impl<T> DowncastSync for T
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more