Struct Task 

pub struct Task {
    pub id: String,
    pub domain: Domain,
    pub prompt: String,
    pub workspace: String,
    pub retrieval_query: Option<String>,
    pub answers: Vec<String>,
    pub target_file: Option<String>,
    pub test_cmd: Option<String>,
}

One scored unit of work. Fixtures are stored as NDJSON (one task per line) so suites are diff-friendly and stream without loading the whole file into a single JSON value.

Fields

id: String

Stable, unique identifier (used in reports + the determinism digest).

domain: Domain

Selects the scorer and the meaning of the remaining fields.

prompt: String

The instruction shown to the model (the “user turn”).

workspace: String

Repo / corpus directory the context is assembled from. Relative paths resolve against the suite file’s parent directory; absolute paths are used as-is.

retrieval_query: Option<String>

Query used to retrieve context in the lean-ctx condition. Defaults to prompt.

answers: Vec<String>

Accepted gold answers. Any match counts (EM/F1 take the best over this set).

target_file: Option<String>

File inside a sandbox copy of workspace that the model output replaces.

test_cmd: Option<String>

Shell command run inside the sandbox; exit code 0 = pass.

Implementations

impl Task

pub fn query(&self) -> &str

The retrieval query for the lean-ctx condition (falls back to the prompt).

pub fn workspace_path(&self, suite_dir: &Path) -> PathBuf

Absolute workspace directory, resolved against suite_dir for relative paths.

Trait Implementations

impl Clone for Task

fn clone(&self) -> Task

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Task

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Task

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for Task

fn eq(&self, other: &Task) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for Task

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Task