pub struct AgentHints {
pub osl: u32,
pub iat: u32,
pub priority: i32,
pub latency_sensitivity: f64,
pub prefix_id: String,
pub total_requests: u32,
}Expand description
Runtime hint bundle exposed to downstream integrations.
These values summarize the current learned default behavior for an agent and are suitable for transport in provider-specific headers or metadata fields.
Fields§
§osl: u32Output-size limit hint in tokens.
iat: u32Inter-arrival-time hint in milliseconds.
priority: i32Scheduling priority hint derived from latency sensitivity.
latency_sensitivity: f64Learned latency sensitivity score for the current prefix.
prefix_id: StringIdentifier of the prefix or trie node the hints came from.
total_requests: u32Estimated total number of requests in the workflow.
Trait Implementations§
Source§impl Clone for AgentHints
impl Clone for AgentHints
Source§fn clone(&self) -> AgentHints
fn clone(&self) -> AgentHints
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for AgentHints
impl Debug for AgentHints
Source§impl<'de> Deserialize<'de> for AgentHints
impl<'de> Deserialize<'de> for AgentHints
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for AgentHints
impl RefUnwindSafe for AgentHints
impl Send for AgentHints
impl Sync for AgentHints
impl Unpin for AgentHints
impl UnsafeUnpin for AgentHints
impl UnwindSafe for AgentHints
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more