Struct RuntimeModelPrediction 

pub struct RuntimeModelPrediction {
    pub response: PredictResponse,
    pub endpoint_total_ns: Option<u64>,
    pub phases: EndpointPhases,
    pub group_size: Option<u64>,
}

The model’s predict reply plus the endpoint-local op duration the peer stamped.

Fields

response: PredictResponse

endpoint_total_ns: Option<u64>

Endpoint-local op duration (ns) from JoinResponse.endpoint_total_ns.

phases: EndpointPhases

The peer’s split of that duration, plus its queue wait and slot depth; all-zero from a peer that sends none.

group_size: Option<u64>

Lanes fused into the model forward this predict rode in (1 = a lone predict). None when the transport does not group predicts; recorded as the group.size telemetry metric when present.