Skip to main content

is_per_task

Function is_per_task 

Source
pub fn is_per_task(dockerfile: &str) -> bool
Expand description

A benchmark is per-task — one eval image baked per task (swe-bench-style) — iff its Dockerfile declares LABEL eval.benchmark.env="per-task". That label is the single source of truth for per-task detection across the CLI (build, run, oracle) and the chart’s perTask value (benchmarks/RULES.md 24f). Matched on a LABEL line so a comment or RUN echo mentioning the string cannot false-positive.