pub struct ExecutionTelemetry {Show 14 fields
pub schema_version: u32,
pub effective_model_type: String,
pub plan: Option<ExecutionPlan>,
pub plan_explanation: Option<PlanExplanation>,
pub hardware: Option<HardwareProfile>,
pub resources: Option<ModelResourceProfile>,
pub prompt_tokens: usize,
pub generated_tokens: usize,
pub stop_reason: String,
pub timing: TimingTelemetry,
pub allocator: Option<AllocatorTelemetry>,
pub residency: Option<ResidencyTelemetry>,
pub expert_cache: Option<ExpertCacheTelemetry>,
pub speculative: Option<SpeculativeDecodingTelemetry>,
}Expand description
Stable JSON telemetry for one completed model execution.
Fields§
§schema_version: u32Version of this serialized telemetry schema.
effective_model_type: StringParsed implementation or nested text-model type used by the runtime.
plan: Option<ExecutionPlan>Concrete execution choices used by the run.
plan_explanation: Option<PlanExplanation>Explanation of how the recorded plan was selected.
hardware: Option<HardwareProfile>Pre-load hardware observations used or available to the caller.
resources: Option<ModelResourceProfile>Header-only model resource observations for the selected load policy.
prompt_tokens: usizeInput token count.
generated_tokens: usizeEmitted token count after terminal-token normalization.
stop_reason: StringStable completion reason.
timing: TimingTelemetryLoad and generation timings.
allocator: Option<AllocatorTelemetry>Backend allocator observations.
residency: Option<ResidencyTelemetry>Bounded ordinary-weight residency observations.
expert_cache: Option<ExpertCacheTelemetry>Independent routed-expert cache observations.
speculative: Option<SpeculativeDecodingTelemetry>Speculative-decoding observations.
Trait Implementations§
Source§impl Clone for ExecutionTelemetry
impl Clone for ExecutionTelemetry
Source§fn clone(&self) -> ExecutionTelemetry
fn clone(&self) -> ExecutionTelemetry
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ExecutionTelemetry
impl Debug for ExecutionTelemetry
Source§impl<'de> Deserialize<'de> for ExecutionTelemetry
impl<'de> Deserialize<'de> for ExecutionTelemetry
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for ExecutionTelemetry
impl PartialEq for ExecutionTelemetry
Source§impl Serialize for ExecutionTelemetry
impl Serialize for ExecutionTelemetry
impl StructuralPartialEq for ExecutionTelemetry
Auto Trait Implementations§
impl Freeze for ExecutionTelemetry
impl RefUnwindSafe for ExecutionTelemetry
impl Send for ExecutionTelemetry
impl Sync for ExecutionTelemetry
impl Unpin for ExecutionTelemetry
impl UnsafeUnpin for ExecutionTelemetry
impl UnwindSafe for ExecutionTelemetry
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more