pub struct ReplayRequest {
pub id: String,
pub arrival_time_ms: f64,
pub input_tokens: usize,
pub input_token_ids: Option<Vec<u32>>,
pub output_tokens: usize,
pub output_token_ids: Option<Vec<u32>>,
pub dp_rank: Option<u32>,
pub session_id: Option<String>,
pub turn_index: Option<usize>,
pub metadata: Value,
}Fields§
§id: String§arrival_time_ms: f64§input_tokens: usize§input_token_ids: Option<Vec<u32>>Materialized prompt content for KV-aware replay. Length-only engine replay may omit it; adapters must never invent tokens when it is needed.
output_tokens: usize§output_token_ids: Option<Vec<u32>>Optional exact generated-token plan. When present, its length controls
native generation while output_tokens remains the authored maximum.
dp_rank: Option<u32>Optional attention-DP rank selected by the workload.
session_id: Option<String>§turn_index: Option<usize>Zero-based turn index within session_id, when the workload has one.
metadata: ValueProvider-neutral request metadata resolved by the selected runner.
Implementations§
Source§impl ReplayRequest
impl ReplayRequest
pub fn validate(&self) -> ReplayResult<()>
Sourcepub fn routing_metadata(&self) -> ReplayResult<ReplayRoutingMetadata>
pub fn routing_metadata(&self) -> ReplayResult<ReplayRoutingMetadata>
Resolve the small routing subset of provider-neutral metadata while leaving the authored metadata value intact for reporting and other adapters.
Trait Implementations§
Source§impl Clone for ReplayRequest
impl Clone for ReplayRequest
Source§fn clone(&self) -> ReplayRequest
fn clone(&self) -> ReplayRequest
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ReplayRequest
impl Debug for ReplayRequest
Source§impl<'de> Deserialize<'de> for ReplayRequest
impl<'de> Deserialize<'de> for ReplayRequest
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for ReplayRequest
impl PartialEq for ReplayRequest
Source§impl Serialize for ReplayRequest
impl Serialize for ReplayRequest
impl StructuralPartialEq for ReplayRequest
Auto Trait Implementations§
impl Freeze for ReplayRequest
impl RefUnwindSafe for ReplayRequest
impl Send for ReplayRequest
impl Sync for ReplayRequest
impl Unpin for ReplayRequest
impl UnsafeUnpin for ReplayRequest
impl UnwindSafe for ReplayRequest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more