pub struct LlmRequestOptions {
pub prompt_cache: Option<LlmPromptCacheInfo>,
pub tool_search: Option<LlmToolSearchInfo>,
pub provider_options: HashMap<String, Value>,
pub metadata: HashMap<String, String>,
}Expand description
Request options applied to an LLM generation.
These fields capture request-side intent such as prompt caching or deferred
tool loading. They complement usage, which captures what actually happened.
Fields§
§prompt_cache: Option<LlmPromptCacheInfo>Prompt caching configuration for this request.
tool_search: Option<LlmToolSearchInfo>Deferred tool-loading configuration for this request.
provider_options: HashMap<String, Value>Provider-specific request options that do not warrant dedicated fields.
metadata: HashMap<String, String>General request metadata passed to the LLM provider for tracking and observability. Includes embedder-supplied labels merged with system tracking keys (session_id, turn_id, etc.).
Implementations§
Trait Implementations§
Source§impl Clone for LlmRequestOptions
impl Clone for LlmRequestOptions
Source§fn clone(&self) -> LlmRequestOptions
fn clone(&self) -> LlmRequestOptions
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LlmRequestOptions
impl Debug for LlmRequestOptions
Source§impl Default for LlmRequestOptions
impl Default for LlmRequestOptions
Source§fn default() -> LlmRequestOptions
fn default() -> LlmRequestOptions
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for LlmRequestOptions
impl<'de> Deserialize<'de> for LlmRequestOptions
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for LlmRequestOptions
impl RefUnwindSafe for LlmRequestOptions
impl Send for LlmRequestOptions
impl Sync for LlmRequestOptions
impl Unpin for LlmRequestOptions
impl UnsafeUnpin for LlmRequestOptions
impl UnwindSafe for LlmRequestOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request