Expand description
Public API types for configuring and reporting tooltest runs.
Re-exports§
pub use schema::parse_call_tool_request;pub use schema::parse_call_tool_result;pub use schema::parse_list_tools;pub use schema::schema_version_label;pub use schema::SchemaError;pub use session::SessionDriver;pub use session::SessionError;
Modules§
Structs§
- Assertion
Check - A single JSON-pointer based check.
- Assertion
Set - Declarative JSON assertion DSL container.
- Call
Tool Request Param - Parameters for calling a tool provided by an MCP server.
- Call
Tool Result - The result of a tool call operation.
- Corpus
Report - Snapshot of the state-machine corpus.
- Coverage
Lint - Lint: enforces coverage validation rules at run completion.
- Coverage
Report - Coverage report for state-machine runs.
- Coverage
Warning - Warning describing a coverage issue in a state-machine run.
- Error
Code - Standard JSON-RPC error codes used throughout the MCP protocol.
- Error
Data - Error information for JSON-RPC error responses.
- Http
Config - Configuration for an HTTP-based MCP endpoint.
- Json
Schema Dialect Compat Lint - Lint: validates tool schema dialects against an allowlist.
- Json
Schema Keyword Compat Lint - Lint: reports
$defsusage with legacy JSON Schema drafts. - Lint
Definition - Definition of a lint instance.
- Lint
Finding - A lint finding emitted during evaluation.
- Lint
Suite - Collection of configured lint rules.
- List
Lint Context - Context for list-phase lint evaluation.
- MaxStructured
Content Bytes Lint - Lint: enforces a maximum structuredContent byte size per response.
- MaxTools
Lint - Lint: checks the raw tools/list count against a configured maximum.
- McpSchema
MinVersion Lint - Lint: enforces a minimum MCP protocol version based on initialize response.
- Minimized
Sequence - A minimized failing sequence from property-based testing.
- Missing
Structured Content Lint - Lint: reports missing structuredContent when an output schema exists.
- NoCrash
Lint - Lint: fails the run when any failure occurred.
- Output
Schema Compile Lint - Lint: reports output schemas that fail to compile.
- PreRun
Hook - Configuration for a pre-run hook command.
- Response
Assertion - Assertions evaluated against a tool response.
- Response
Lint Context - Context for response-phase lint evaluation.
- RunConfig
- Top-level configuration for executing a tooltest run.
- RunFailure
- Failure details for a tooltest run.
- RunLint
Context - Context for run-phase lint evaluation.
- RunResult
- Results of a tooltest run.
- RunWarning
- Warning emitted during a tooltest run.
- RunWarning
Code - Structured warning codes for tooltest runs.
- Runner
Options - Configuration for proptest-driven run behavior.
- Schema
Config - Configuration for MCP schema parsing and validation.
- Sequence
Assertion - Assertions evaluated against the entire run sequence.
- State
Machine Config - Configuration for state-machine generator behavior.
- Stdio
Config - Configuration for a stdio-based MCP endpoint.
- Tool
- A tool that can be used by a model.
- Tooltest
Http Target - HTTP transport input configuration.
- Tooltest
Input - Shared tooltest input type for CLI and MCP modes.
- Tooltest
PreRun Hook - Pre-run hook input configuration.
- Tooltest
RunConfig - Combined configuration output from shared tooltest input.
- Tooltest
Stdio Target - Stdio transport input configuration.
- Tooltest
Target Http - Tooltest
Target Stdio - Uncallable
Tool Call - Recorded call details for tools with zero successes.
Enums§
- Assertion
Rule - A single assertion rule in the JSON DSL.
- Assertion
Target - Payload targets that can be inspected by assertions.
- Client
Initialize Error - It represents the error that may occur when serving the client.
- Coverage
Rule - Coverage validation rules for state-machine runs.
- Coverage
Warning Reason - Structured reason codes for coverage warnings.
- Lint
Config Source - Source of the lint configuration for the run.
- Lint
Level - Severity levels for lint findings.
- Lint
Phase - Phases in which lints are evaluated.
- List
Tools Error - Errors emitted while listing tools.
- RunOutcome
- Outcome of a tooltest run.
- Schema
Version - Schema versions supported by the tooltest core.
- Service
Error - Tooltest
Target - Target configuration input wrapper.
- Tooltest
Target Config - Target configuration for a tooltest run.
- Trace
Entry - A trace entry capturing MCP interactions.
Constants§
Traits§
Functions§
- default_
tooltest_ toml - list_
tools_ http - Lists tools from an HTTP MCP endpoint using the provided configuration.
- list_
tools_ stdio - Lists tools from a stdio MCP endpoint using the provided configuration.
- list_
tools_ with_ session - Lists tools from an active session using MCP schema validation.
- load_
lint_ suite - run_
http - Execute a tooltest run against an HTTP MCP endpoint.
- run_
stdio - Execute a tooltest run against a stdio MCP endpoint.
- run_
with_ session - Execute a tooltest run using a pre-initialized session.
Type Aliases§
- Json
Object - A JSON object type alias for convenient handling of JSON data.
- Tool
Invocation - A generated tool invocation.
- Tool
Name Predicate - Tool
Predicate - Predicate callback used to decide whether a tool invocation is eligible.