Struct FramesLoader 

pub struct FramesLoader;

Loads FRAMES benchmark scenarios from a JSONL file.

Source: google/frames-benchmark on HuggingFace.

Schema: one JSON object per line:

{"Prompt": "...", "Answer": "...", "reasoning_types": [...], "wiki_links": [...]}

Each non-empty line becomes one Scenario:

• id — "frames_{line_number}" (zero-based, counting from the first line of the file).
• prompt — value of "Prompt".
• expected — value of "Answer".
• metadata — value of "reasoning_types" (array of strings, or null).

Empty lines are skipped. Unknown fields (e.g. "wiki_links") are ignored.

Examples

use std::path::Path;
use zeph_bench::loaders::FramesLoader;
use zeph_bench::scenario::DatasetLoader;

let scenarios = FramesLoader.load(Path::new("/data/frames.jsonl")).unwrap();
println!("loaded {} scenarios", scenarios.len());

Trait Implementations

impl DatasetLoader for FramesLoader

fn load(&self, path: &Path) -> Result<Vec<Scenario>, BenchError>

Errors

Returns BenchError::Io when the file cannot be read and BenchError::InvalidFormat when a JSONL line cannot be parsed.

fn name(&self) -> &'static str

Short identifier matching the dataset name in crate::DatasetRegistry.

impl Debug for FramesLoader

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.