pub struct BedrockCacheConfig {
pub ttl: BedrockCacheTtl,
}Available on crate features
models and bedrock only.Expand description
Configuration for Bedrock prompt caching.
When enabled on BedrockConfig, the Bedrock request builder injects
CachePoint blocks after system prompts and tool definitions.
§Example
use adk_model::bedrock::{BedrockCacheConfig, BedrockCacheTtl};
// Default 5-minute TTL
let config = BedrockCacheConfig::default();
// 1-hour TTL for supported models
let config = BedrockCacheConfig { ttl: BedrockCacheTtl::OneHour };Fields§
§ttl: BedrockCacheTtlCache time-to-live. Defaults to 5 minutes.
Trait Implementations§
Source§impl Clone for BedrockCacheConfig
impl Clone for BedrockCacheConfig
Source§fn clone(&self) -> BedrockCacheConfig
fn clone(&self) -> BedrockCacheConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for BedrockCacheConfig
impl Debug for BedrockCacheConfig
Source§impl Default for BedrockCacheConfig
impl Default for BedrockCacheConfig
Source§fn default() -> BedrockCacheConfig
fn default() -> BedrockCacheConfig
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for BedrockCacheConfig
impl<'de> Deserialize<'de> for BedrockCacheConfig
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<BedrockCacheConfig, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<BedrockCacheConfig, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Serialize for BedrockCacheConfig
impl Serialize for BedrockCacheConfig
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
Auto Trait Implementations§
impl Freeze for BedrockCacheConfig
impl RefUnwindSafe for BedrockCacheConfig
impl Send for BedrockCacheConfig
impl Sync for BedrockCacheConfig
impl Unpin for BedrockCacheConfig
impl UnsafeUnpin for BedrockCacheConfig
impl UnwindSafe for BedrockCacheConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::RequestCreates a shared type from an unshared type.