Skip to main content

Module experiment

Module experiment 

Source
Expand description

Experiment execution: baseline/patched paired trials with typed diffs.

Structs§

AnalysisRecord
Record of analysis derived from execution.
EvidenceRecord
Record of evidence produced.
ExecutionRecord
Record of execution details (how it ran).
ExperimentConfig
Configuration for a single experiment.
ExperimentDiff
Typed diff between baseline and patched experiment results.
ExperimentExportRecord
Record of export to semantic-memory.
ExperimentResult
Result of running an experiment.
PairedExperimentRunner
Real experiment runner that executes baseline and patched checks.
RunIdentity
Identity of an experiment run (who/what/when).
StatisticsPolicy
Policy controlling statistical validity claims.
TrialRecord
Record of a single trial execution (baseline or patched).
TypedLocatedEffect
An effect located in the experiment diff.

Enums§

CacheMode
Whether build caches were warm or cold during a trial execution.
EffectKind
Classification of an observed effect from experiment comparison.
ExperimentMode
How an experiment is structured.
TrialSide
Which side of a paired experiment a trial belongs to.