Enum TestEvent 

pub enum TestEvent {
    RunStarted {
        total_tests: u32,
    },
    TestStarted {
        test: String,
    },
    StepStarted {
        test: String,
        index: u32,
        label: String,
    },
    StepFinished {
        test: String,
        index: u32,
        label: String,
        status: StepStatus,
        duration_ms: u64,
        message: String,
        diagnostics: Option<String>,
        screenshot: Option<String>,
    },
    LlmCallStarted {
        test: String,
        index: u32,
        endpoint: String,
        model: String,
        purpose: String,
    },
    LlmCallFinished {
        test: String,
        index: u32,
        endpoint: String,
        model: String,
        purpose: String,
        ok: bool,
        duration_ms: u64,
        input_tokens: u64,
        output_tokens: u64,
        cached_input_tokens: u64,
        cost: f64,
        error: Option<String>,
    },
    TestFinished {
        test: String,
        passed: u32,
        failed: u32,
        skipped: u32,
        duration_ms: u64,
        cost: f64,
        tokens: u64,
        input_tokens: u64,
        output_tokens: u64,
        cached_input_tokens: u64,
        models: Vec<String>,
        calls: u64,
    },
    RunFinished {
        tests_passed: u32,
        tests_failed: u32,
        steps_passed: u32,
        steps_failed: u32,
        steps_skipped: u32,
        total_cost: f64,
        total_tokens: u64,
        total_input_tokens: u64,
        total_output_tokens: u64,
        total_cached_input_tokens: u64,
        models: Vec<String>,
        total_calls: u64,
    },
    Warning {
        message: String,
    },
}

One event in the run’s lifecycle.

Serialized as a flat JSON object with a type discriminator, e.g. {"type":"step_finished","test":"login","status":"passed",...}. The reporter adds a ts (epoch milliseconds) field on emission.

Variants

RunStarted

The run is about to execute total_tests tests.

Fields

total_tests: u32

Number of tests in the run.

TestStarted

A test started.

Fields

test: String

Test name (includes viewport-matrix suffix when expanded).

StepStarted

A step inside a test started.

Fields

test: String

Enclosing test name.

index: u32

Zero-based step index within the test.

label: String

Human-readable label, e.g. [click] the sign-in button.

StepFinished

A step finished.

Fields

test: String

Enclosing test name.

index: u32

Zero-based step index within the test.

label: String

Human-readable label, e.g. [click] the sign-in button.

status: StepStatus

Outcome of the step.

duration_ms: u64

Wall-clock duration of the step.

message: String

Human-readable result message (includes the page-state excerpt and the failure message for failed steps).

diagnostics: Option<String>

Multi-line failure diagnostics (URL, title, visible text, alerts) — None for non-failed steps.

screenshot: Option<String>

Path of the failure screenshot, if one was written.

LlmCallStarted

An LLM call started (one per attempted endpoint chain).

Fields

test: String

Enclosing test name.

index: u32

Zero-based step index within the test.

endpoint: String

Endpoint name (or chain entry) being called.

model: String

Model name sent in the request.

purpose: String

Call purpose: targeting or assertion.

LlmCallFinished

An LLM call finished (success or exhaustion of all attempts).

Fields

test: String

Enclosing test name.

index: u32

Zero-based step index within the test.

endpoint: String

Endpoint that answered (or the last one tried on failure).

model: String

Model name used.

purpose: String

Call purpose: targeting or assertion.

ok: bool

Whether an answer was obtained.

duration_ms: u64

Wall-clock duration of the call including retries.

input_tokens: u64

Input (prompt) tokens billed.

output_tokens: u64

Output (completion) tokens billed.

cached_input_tokens: u64

Input tokens served from the provider’s prompt cache.

cost: f64

Computed cost in USD.

error: Option<String>

Error message when ok is false.

TestFinished

A test finished.

Fields

test: String

Test name.

passed: u32

Number of passed steps.

failed: u32

Number of failed steps.

skipped: u32

Number of skipped steps.

duration_ms: u64

Wall-clock duration of the whole test.

cost: f64

Total cost of the test in USD.

tokens: u64

Total tokens consumed by the test.

input_tokens: u64

Input (prompt) tokens consumed by the test.

output_tokens: u64

Output (completion) tokens consumed by the test.

cached_input_tokens: u64

Input tokens served from provider prompt caches.

models: Vec<String>

Models used by the test, sorted and deduplicated.

calls: u64

Total LLM/MCP/agent calls made by the test.

RunFinished

The whole run finished.

Fields

tests_passed: u32

Tests that passed.

tests_failed: u32

Tests that failed.

steps_passed: u32

Steps that passed.

steps_failed: u32

Steps that failed.

steps_skipped: u32

Steps that were skipped.

total_cost: f64

Total cost in USD across all tests.

total_tokens: u64

Total tokens consumed.

total_input_tokens: u64

Total input (prompt) tokens consumed.

total_output_tokens: u64

Total output (completion) tokens consumed.

total_cached_input_tokens: u64

Total input tokens served from provider prompt caches.

models: Vec<String>

Models used across the run, sorted and deduplicated.

total_calls: u64

Total calls made.

Warning

A non-fatal warning (budget soft-exceeded, feature not enabled, …).

Fields

message: String

Human-readable warning text.

Trait Implementations

impl Clone for TestEvent

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TestEvent

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for TestEvent

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.