pub struct Card {Show 18 fields
pub schema: String,
pub title: String,
pub producer: Producer,
pub model: Option<Model>,
pub task: Option<Task>,
pub harness: Option<Harness>,
pub generation: Option<Generation>,
pub trial: Option<Trial>,
pub grading: Option<Grading>,
pub env: Option<Env>,
pub results: Vec<ResultEntry>,
pub counts: Option<Counts>,
pub run_results: Vec<RunResult>,
pub relations: Vec<Relation>,
pub attachments: Vec<Attachment>,
pub redaction: Option<Redaction>,
pub provenance: Option<Provenance>,
pub ext: Ext,
}Expand description
A Card: what was measured, how, and what the score was.
Fields§
§schema: StringSchema identifier: evalhub.card/1.1, or evalhub.card/1.0, which is
still accepted. Both are described by this one schema.
title: StringHuman-readable title.
producer: ProducerThe software that wrote this record.
model: Option<Model>The model facet.
task: Option<Task>The task facet.
harness: Option<Harness>The harness facet.
generation: Option<Generation>The generation facet.
trial: Option<Trial>The trial facet.
grading: Option<Grading>The grading facet.
env: Option<Env>The environment facet.
results: Vec<ResultEntry>The scores.
counts: Option<Counts>Item counts the scores were computed over. Required when results is non-empty.
run_results: Vec<RunResult>Per-run verdicts on the runs of the Evals this Card uses
(core/uses_eval). Each run_id must be in the Card’s used set for
its eval. Added in evalhub.card/1.1.
relations: Vec<Relation>Edges to other records.
attachments: Vec<Attachment>Files this record refers to.
redaction: Option<Redaction>What the producer removed before publishing.
provenance: Option<Provenance>Where the numbers came from and who ran the evaluation.
ext: ExtProducer-private extensions keyed by namespace.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for Card
impl<'de> Deserialize<'de> for Card
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Source§impl JsonSchema for Card
impl JsonSchema for Card
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
$ref keyword. Read more