Skip to main content

Crate apr_qa_gen

Crate apr_qa_gen 

Source
Expand description

APR QA Scenario Generator

Property-based test scenario generation for model qualification. Implements the Popperian falsification methodology from the APR Playbook Spec.

§Design Philosophy

“The criterion of the scientific status of a theory is its falsifiability.” — Karl Popper, Conjectures and Refutations (1963)

Every generated scenario is a falsifiable hypothesis about model behavior.

Re-exports§

pub use error::Error;
pub use error::Result;
pub use hf_parity::GoldenOutput;
pub use hf_parity::HfParityOracle;
pub use hf_parity::TensorDiff;
pub use hf_parity::Tolerance;
pub use hf_parity::hash_prompt;
pub use models::ModelId;
pub use models::ModelRegistry;
pub use models::SizeCategory;
pub use oracle::Oracle;
pub use oracle::OracleResult;
pub use scenario::AprTool;
pub use scenario::Backend;
pub use scenario::Format;
pub use scenario::Modality;
pub use scenario::QaScenario;
pub use scenario::ScenarioGenerator;
pub use scenario::TraceLevel;

Modules§

error
Error types for apr-qa-gen
hf_parity
HuggingFace Parity Oracle
models
Model registry and metadata
oracle
Oracle definitions for output verification
proptest_impl
Proptest implementations for property-based testing
scenario
QA Scenario generation