Skip to main content

Module runner

Module runner 

Source
Available on crate feature runner only.
Expand description

Agent execution runtime.

The engine that manages agent execution:

  • Runner - Executes agents with full context
  • RunnerConfig - Configuration options
  • Event streaming and tool coordination

Available with feature: runner

Modules§

builder
Typestate builder for RunnerConfig / Runner.
intra_compaction
Intra-invocation context compaction trigger logic.

Structs§

CacheMetrics
Metrics computed from session event history.
CachePerformanceAnalyzer
Utility for computing cache effectiveness metrics from session events.
Callbacks
Collection of all callback types
ContextCacheConfig
Configuration for automatic prompt caching lifecycle management.
EventsCompactionConfig
Configuration for automatic context compaction.
IntraCompactionConfig
Configuration for intra-invocation context compaction.
IntraInvocationCompactor
Intra-invocation compactor that monitors token usage during a single invocation and triggers summarization when the context exceeds a threshold.
InvocationContext
MutableSession
MutableSession wraps a session with shared mutable state.
RequestContext
Identity and authorization context extracted from an HTTP request.
Runner
RunnerConfig
RunnerConfigBuilder
A typestate builder for constructing a Runner.

Traits§

BaseEventsSummarizer
Trait for summarizing events during context compaction.
CacheCapable
Trait for LLM providers that support prompt caching.
SecretService
Trait for retrieving secrets at runtime.

Type Aliases§

AfterModelCallback
Callback executed after model response
AfterToolCallback
Callback executed after tool execution
BeforeModelCallback
Callback executed before calling the model
BeforeToolCallback
Callback executed before tool execution