List of all items
Structs
- AgentConfig
- AgentSpec
- DiffStats
- DockerAgent
- DockerImage
- DockerImageParseError
- EvalFilesReport
- EvalOutcome
- EvalSpec
- EvalSpecLoadOptions
- EvalToolCall
- Expect
- FakeAgent
- GitDiff
- GitRepoSpec
- Judge
- JudgeBuilder
- JudgeContext
- JudgeCriterionResponse
- JudgeCriterionSpec
- JudgeCriterionSummary
- JudgeRubricResponse
- JudgeSpec
- JudgeSummary
- ResolvedEvalSpec
- RetainedWorkspaceInfo
- Task
- TaskRun
- TaskRunError
- TaskSpec
- ToolCall
- Transcript
- Workspace
Enums
- DockerSpec
- EvalFileError
- EvalRunError
- EvalStreamEvent
- GitRepoError
- ImageBuildError
- JudgeError
- RunError
- ToolCallExpectation
- WorkspaceError
- WorkspaceRetention
- WorkspaceSource
- WorkspaceSpec
Traits
Functions
- assert_tool_call_count
- assert_tool_call_with_args
- assert_tool_called
- default_eval_env_vars
- judge
- run_eval_spec_streaming
- run_eval_specs