Expand description
Experiment execution: baseline/patched paired trials with typed diffs.
Structs§
- Analysis
Record - Record of analysis derived from execution.
- Evidence
Record - Record of evidence produced.
- Execution
Record - Record of execution details (how it ran).
- Experiment
Config - Configuration for a single experiment.
- Experiment
Diff - Typed diff between baseline and patched experiment results.
- Experiment
Export Record - Record of export to semantic-memory.
- Experiment
Result - Result of running an experiment.
- Paired
Experiment Runner - Real experiment runner that executes baseline and patched checks.
- RunIdentity
- Identity of an experiment run (who/what/when).
- Statistics
Policy - Policy controlling statistical validity claims.
- Trial
Record - Record of a single trial execution (baseline or patched).
- Typed
Located Effect - An effect located in the experiment diff.
Enums§
- Cache
Mode - Whether build caches were warm or cold during a trial execution.
- Effect
Kind - Classification of an observed effect from experiment comparison.
- Experiment
Mode - How an experiment is structured.
- Trial
Side - Which side of a paired experiment a trial belongs to.