Struct SweBenchAdapter 

pub struct SweBenchAdapter { /* private fields */ }

SWE-bench Verified pass@5 adapter for the success rate measurement.

Implementations

impl SweBenchAdapter

pub fn new() -> Result<Self, SweBenchError>

Create a new SWE-bench adapter with the canonical endpoint.

pub fn with_endpoint(endpoint: Url) -> Self

Create a SWE-bench adapter with a custom endpoint (for testing).

Trait Implementations

impl Default for SweBenchAdapter

fn default() -> Self

Returns the “default value” for a type.

impl Source for SweBenchAdapter

type Raw = SweBenchRaw

The native schema for this source’s upstream data.

type Error = SweBenchError

Error type for parse/to_evidence failures.

fn id(&self) -> SourceId

Stable identifier for this source (e.g., “arc-agi-3”).

fn endpoint(&self) -> &Url

The URL or endpoint this source ingests from.

fn parse(&self, raw: &str) -> Result<Self::Raw, Self::Error>

Parse raw upstream data (JSON string) into the typed schema. Fails closed on any malformed input.

fn to_evidence( &self, raw: Self::Raw, _model: &ModelId, ) -> Result<Vec<Evidence>, Self::Error>

Convert validated raw data into agi4-core Evidence values. One source may produce evidence for multiple conjuncts (e.g., ARC-AGI-3 contributes to both Generality and EnvironmentalTransfer).