Expand description
In-memory loops, test doubles, writable fixtures, and demo capabilities for testing Everruns agents.
everruns-test-support is the testing and demonstration companion to the
production-safe everruns-llmsim crate.
It keeps reusable helpers out of production compositions:
in_memory_loop— a full in-memory agentic loop with no database or network (sim+hostfeatures)in_memory— deterministic message and event fixtures for isolated tests; hosted loops use canonical event history insteaddoubles— mock/echo/failing tool executors and a mock chat drivermcp— a stateful mock MCP resource and OAuth authorization servercapabilities— fake AWS/CRM/financial/warehouse demo capabilities and the test math/weather, sample-data, and noop fixtures (fixturesfeature)- a source-compatible 0.18 migration bridge for the simulator types and
host extension previously published here, including registration-only
.llm_sim(...)and explicit.llm_sim_as_default(...)(sim/hostfeatures)
Production code should use everruns::Model::simulated or depend on
everruns-llmsim directly. Do not add a production dependency on this
crate or register its fixture capabilities.
§Example
use everruns_test_support::{InMemoryAgenticLoop, TestMathCapability};
let agent = InMemoryAgenticLoop::builder()
.with_simulated_response("2 + 2 = 4")
.capability(TestMathCapability)
.build()
.await?;
let result = agent.run_turn("What is 2 + 2?").await?;
assert!(result.success);Re-exports§
pub use doubles::EchoToolExecutor;pub use doubles::FailingToolExecutor;pub use doubles::MockLlmResponse;pub use doubles::MockProvider;pub use doubles::MockToolExecutor;pub use in_memory::InMemoryEventEmitter;pub use in_memory::InMemoryMessageRetriever;pub use in_memory_loop::InMemoryAgenticLoop;pub use in_memory_loop::InMemoryAgenticLoopBuilder;pub use mcp::MockCallResponse;pub use mcp::MockMcpOAuthServer;pub use mcp::MockMcpProtocolEra;pub use mcp::MockOAuthError;pub use mcp::RecordedMcpRequest;pub use mcp::RecordedOAuthRequest;pub use capabilities::FAKE_AWS_CAPABILITY_ID;pub use capabilities::FAKE_CRM_CAPABILITY_ID;pub use capabilities::FAKE_FINANCIAL_CAPABILITY_ID;pub use capabilities::FAKE_WAREHOUSE_CAPABILITY_ID;pub use capabilities::FakeAwsCapability;pub use capabilities::FakeCrmCapability;pub use capabilities::FakeFinancialCapability;pub use capabilities::FakeWarehouseCapability;pub use capabilities::NOOP_CAPABILITY_ID;pub use capabilities::NoopCapability;pub use capabilities::SAMPLE_DATA_CAPABILITY_ID;pub use capabilities::SampleDataCapability;pub use capabilities::TEST_MATH_CAPABILITY_ID;pub use capabilities::TEST_WEATHER_CAPABILITY_ID;pub use capabilities::TestMathCapability;pub use capabilities::TestWeatherCapability;
Modules§
- capabilities
- Demo and test fixture capabilities.
- doubles
- in_
memory - Deterministic in-memory fixtures for isolated tests.
- in_
memory_ loop - llmsim_
driver - Compatibility module preserving the 0.17 simulator path during the 0.18 migration.
- mcp
- Shared MCP and OAuth test harness. In-memory MCP resource and OAuth authorization server for integration tests.
Structs§
- LlmSim
Config - Configuration for the LlmSim driver.
- LlmSim
Driver - Deterministic LLM simulator driver.
- SimTool
Call - A single tool call inside a scripted turn.
- Tool
Call Pattern - Pattern for conditional tool calls
Enums§
- OnExhausted
- Behavior when a scripted config has consumed all turns.
- Response
Config - Response generation configuration.
- SimError
- Error to inject for a scripted turn.
- SimTurn
- A single scripted assistant turn.
- Tool
Call Config - Tool call configuration.
Constants§
- LLMSIM_
MODEL_ ID - Canonical model id served by the
llmsimprovider. - LLMSIM_
PROVIDER - Canonical provider name and model id used by simulated runtimes.
Traits§
- LlmSim
Runtime Ext - Deterministic-simulation sugar for runtime builders.
Functions§
- llm_
sim_ provider - Build an
llmsimprovider from a simulator configuration. - reason_
atom_ with_ stores - Compose a reason atom from in-memory stores for tests and examples.