Skip to main content

Run

Struct Run 

Source
pub struct Run {
Show 18 fields pub run_id: String, pub status: RunStatus, pub error: Option<RunError>, pub skip_reason: Option<String>, pub started_at: Option<DateTime<Utc>>, pub ended_at: Option<DateTime<Utc>>, pub model: Option<Model>, pub task: Option<Task>, pub harness: Option<Harness>, pub generation: Option<Generation>, pub trial: Option<Trial>, pub env: Option<Env>, pub calls: Option<String>, pub artifacts: Vec<String>, pub attachments: Vec<Attachment>, pub metrics: BTreeMap<String, f64>, pub ext: Ext, pub meta: Option<Value>,
}
Expand description

One run of an Eval: one execution, its conditions, its files and what was measured directly from it. A run records what happened, never whether it passed; the verdict is a Card’s run_results.

Fields§

§run_id: String

Run identifier, unique within the Eval record. One URL segment: non-empty, no /, at most 200 bytes.

§status: RunStatus

The state of the execution: ok, error or skipped.

§error: Option<RunError>

How the run failed. Present exactly when status is error.

§skip_reason: Option<String>

Why the producer did not execute the run. Present exactly when status is skipped.

§started_at: Option<DateTime<Utc>>

When the run started.

§ended_at: Option<DateTime<Utc>>

When the run ended.

§model: Option<Model>

The model this run used. Filled from the Eval header when omitted.

§task: Option<Task>

The task this run attempted. Filled from the Eval header when omitted.

§harness: Option<Harness>

The harness that drove this run. Filled from the Eval header when omitted.

§generation: Option<Generation>

The sampling parameters of this run. Filled from the Eval header when omitted.

§trial: Option<Trial>

How this run’s attempt was made. Filled from the Eval header when omitted.

§env: Option<Env>

The environment this run executed in. Filled from the Eval header when omitted.

§calls: Option<String>

This run’s attachments[].path holding the model calls made during the run.

§artifacts: Vec<String>

This run’s attachments[].path entries of artifacts the run produced.

§attachments: Vec<Attachment>

Files this run refers to. calls, artifacts[] and error.log point here.

§metrics: BTreeMap<String, f64>

Values measured directly from the run, keyed by metric registry id {ns}/{name} (for example core/tokens_out). Grader-dependent values belong to a Card’s run_results, not here.

§ext: Ext

Producer-private extensions keyed by namespace.

§meta: Option<Value>

Free-form JSON kept with the run and returned verbatim. The hub never validates, indexes or queries it.

Trait Implementations§

Source§

impl Clone for Run

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for Run

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<'de> Deserialize<'de> for Run

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl JsonSchema for Run

Source§

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema. Read more
Source§

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type. Read more
Source§

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type. Read more
Source§

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword. Read more
Source§

impl PartialEq for Run

Source§

fn eq(&self, other: &Self) -> bool

Equality operator ==. Read more
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=. Read more
Source§

impl Serialize for Run

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for Run

Auto Trait Implementations§

§

impl Freeze for Run

§

impl RefUnwindSafe for Run

§

impl Send for Run

§

impl Sync for Run

§

impl Unpin for Run

§

impl UnsafeUnpin for Run

§

impl UnwindSafe for Run

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,

Source§

impl<T> DynClone for T
where T: Clone,

Source§

fn __clone_box(&self, _: Private) -> *mut ()

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.