Module host_run 

Host run records and their case measures, rustev.host-run/1 and rustev.host-cases/1 (spec 061, 3.1 to 3.3).

A host whose runs execute in its own runtime supplies one record per run, naming its views and scores by record digest. Rustev checks the record’s fields, binds the views and scores to it, and computes each case’s measures: the score metrics of spec 041 over the answered cases and the host/ metrics over every case. Every figure here is computed from host-asserted observations: Rustev did not observe the run, and no host document carries a Rustev plan or dataset identity (I-2).

Modules

code

Refusal codes (3.2, 3.4, 3.6).

metric

The host/ metrics (3.3.3), in report order.

Structs

HostCase

HostCaseMeasures

HostCases

One run’s case measures (3.3.1): spec 029’s per-case document, bound to the host run record instead of a run report.

HostDataset

The host’s dataset as it asserts it; Rustev reads no dataset bytes.

HostError

A refusal of spec 061 (invalid_input, 3.9), naming the run when it is one run’s, and its code.

HostIdentity

HostMeasured

A run’s measures and its per-run metric values, in report order.

HostMetric

HostRun

One host run (3.1.1). Its record digest is the run identity Rustev binds.

HostRunInputs

One bound run: its record, views and scores documents, with the evaluator configuration that declares the scorers.

Unobserved

{ "unknown": reason }: a value the host did not observe (I-3).

Enums

Assertion

Every host document states that its observations are the host’s (3.5.3).

HostCost

HostLatency

HostOutcome

Constants

COST_NOT_DECLARED

Why host/cost_per_1000 is unknown when the record declares no unit.

HOST_CASES

HOST_RUN

MAX_LATENCY_US

The largest latency a record states, in microseconds (3.1.4).

MAX_SCORES

At most one scores document per scorer, and at most 16 scorers (3.1.5).

Functions

bind

The binding checks of 3.2.2, before any statistic: the record’s fields, the views and scores digests it names, the views’ configuration, split, cases and subgroups, each entry’s subject, and spec 041 3.7.5’s scores checks.

declarations

The configuration’s version 3 declarations, or config.

form

The form of a host/ metric’s measure (3.3.3); none for any other name.

measure

Measure one bound run (3.3): the host/ metrics over every case, then the score metrics of spec 041 over the answered cases, deterministic ones first, by the functions spec 041’s evaluation uses. Metrics spec 004 or 041 define from Rustev decision records are not produced.