aether-evals 0.3.21

Dockerized eval harness for Aether AI agents
Documentation
# Changelog

All notable changes to this project will be documented in this file.

## [0.3.21]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.20...aether-evals-v0.3.21 - 2026-10-12

### Other

- updated the following local packages: aether-llm, aether-agent-core

## [0.3.20]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.19...aether-evals-v0.3.20 - 2026-10-10

### Other

- updated the following local packages: aether-llm, aether-agent-core

## [0.3.19]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.18...aether-evals-v0.3.19 - 2026-10-08

### Other

- updated the following local packages: aether-llm, aether-agent-core

## [0.3.18]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.17...aether-evals-v0.3.18 - 2026-10-05

### Other

- updated the following local packages: aether-llm, aether-agent-core

## [0.3.17]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.16...aether-evals-v0.3.17 - 2026-10-04

### Fixed

- wait for docker eval commands before container cleanup ([#568]https://github.com/contextbridge/aether/pull/568)

## [0.3.16]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.15...aether-evals-v0.3.16 - 2026-10-04

### Added

- *(aether-evals)* add privileged container options to evals ([#565]https://github.com/contextbridge/aether/pull/565)

## [0.3.15]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.14...aether-evals-v0.3.15 - 2026-10-03

### Other

- updated the following local packages: aether-agent-core, aether-llm

## [0.3.14]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.13...aether-evals-v0.3.14 - 2026-10-01

### Fixed

- support bedrock gpt-6.1-sol routing and clean up dependencies ([#553]https://github.com/contextbridge/aether/pull/553)

## [0.3.13]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.12...aether-evals-v0.3.13 - 2026-09-28

### Other

- Fix/aether server logs when detached ([#531]https://github.com/contextbridge/aether/pull/531)

## [0.3.12]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.11...aether-evals-v0.3.12 - 2026-09-27

### Other

- updated the following local packages: aether-agent-core, aether-project, aether-llm

## [0.3.11]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.10...aether-evals-v0.3.11 - 2026-09-24

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.3.10]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.9...aether-evals-v0.3.10 - 2026-09-23

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.3.9]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.8...aether-evals-v0.3.9 - 2026-09-21

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.3.8]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.7...aether-evals-v0.3.8 - 2026-09-20

### Other

- updated the following local packages: aether-agent-core, aether-project, aether-llm

## [0.3.7]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.6...aether-evals-v0.3.7 - 2026-09-19

### Other

- updated the following local packages: aether-project

## [0.3.6]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.5...aether-evals-v0.3.6 - 2026-09-16

### Other

- release ([#466]https://github.com/contextbridge/aether/pull/466)

## [0.3.5]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.4...aether-evals-v0.3.5 - 2026-09-14

### Other

- updated the following local packages: aether-agent-core, aether-project

## [0.3.4]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.3...aether-evals-v0.3.4 - 2026-09-14

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.3.3]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.2...aether-evals-v0.3.3 - 2026-09-11

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.3.2]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.1...aether-evals-v0.3.2 - 2026-09-09

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.3.1]https://github.com/contextbridge/aether/compare/aether-evals-v0.3.0...aether-evals-v0.3.1 - 2026-09-04

### Other

- Bedrock Responses response.failed events with server errors are not retried ([#410]https://github.com/contextbridge/aether/pull/410)

## [0.3.0]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.30...aether-evals-v0.3.0 - 2026-09-03

### Added

- *(aether-cli)* [**breaking**] add session usage and cost tracking ([#405]https://github.com/contextbridge/aether/pull/405)

## [0.2.30]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.29...aether-evals-v0.2.30 - 2026-08-31

### Other

- updated the following local packages: aether-agent-core, aether-project

## [0.2.29]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.28...aether-evals-v0.2.29 - 2026-08-31

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.28]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.27...aether-evals-v0.2.28 - 2026-08-27

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.27]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.26...aether-evals-v0.2.27 - 2026-08-22

### Other

- updated the following local packages: aether-agent-core, aether-llm, aether-project

## [0.2.26]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.25...aether-evals-v0.2.26 - 2026-08-20

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.25]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.24...aether-evals-v0.2.25 - 2026-08-19

### Other

- scheduled code-cleanup ([#329]https://github.com/contextbridge/aether/pull/329)

## [0.2.24]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.23...aether-evals-v0.2.24 - 2026-08-04

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.23]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.22...aether-evals-v0.2.23 - 2026-07-29

### Other

- updated the following local packages: aether-agent-core, aether-project

## [0.2.22]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.21...aether-evals-v0.2.22 - 2026-07-29

### Other

- updated the following local packages: aether-agent-core, aether-project

## [0.2.21]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.20...aether-evals-v0.2.21 - 2026-07-29

### Fixed

- *(aether-evals)* capture agent diff from start commit ([#306]https://github.com/contextbridge/aether/pull/306)

## [0.2.20]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.19...aether-evals-v0.2.20 - 2026-07-29

### Other

- updated the following local packages: aether-agent-core, aether-project

## [0.2.19]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.18...aether-evals-v0.2.19 - 2026-07-28

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.18]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.17...aether-evals-v0.2.18 - 2026-07-28

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.17]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.16...aether-evals-v0.2.17 - 2026-07-27

### Added

- *(llm)* Add support for bedrock mantle models ([#293]https://github.com/contextbridge/aether/pull/293)

### Other

- scheduled code-cleanup ([#276]https://github.com/contextbridge/aether/pull/276)

## [0.2.16]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.15...aether-evals-v0.2.16 - 2026-07-21

### Other

- updated the following local packages: aether-project

## [0.2.15]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.14...aether-evals-v0.2.15 - 2026-07-20

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.14]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.13...aether-evals-v0.2.14 - 2026-07-20

### Other

- scheduled code-cleanup ([#246]https://github.com/contextbridge/aether/pull/246)

## [0.2.13]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.12...aether-evals-v0.2.13 - 2026-07-13

### Other

- reduce development compile costs ([#231]https://github.com/contextbridge/aether/pull/231)

## [0.2.12]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.11...aether-evals-v0.2.12 - 2026-07-13

### Other

- updated the following local packages: aether-llm, aether-project, aether-agent-core

## [0.2.11]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.10...aether-evals-v0.2.11 - 2026-07-13

### Other

- Rename AgentMessage => AgentEvent and better organize variants ([#217]https://github.com/contextbridge/aether/pull/217)

## [0.2.10]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.9...aether-evals-v0.2.10 - 2026-07-09

### Other

- updated the following local packages: aether-llm, aether-project, aether-agent-core

## [0.2.9]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.8...aether-evals-v0.2.9 - 2026-06-30

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.8]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.7...aether-evals-v0.2.8 - 2026-06-22

### Added

- Support instantiating eval workspaces from a git bundle file ([#194]https://github.com/contextbridge/aether/pull/194)

## [0.2.7]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.6...aether-evals-v0.2.7 - 2026-06-22

### Other

- *(aether-evals)* Refactor unstable eval API ([#180]https://github.com/contextbridge/aether/pull/180)
- *(aether-evals)* Expose token usage stats for evals ([#179]https://github.com/contextbridge/aether/pull/179)

## [0.2.6]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.5...aether-evals-v0.2.6 - 2026-06-19

### Other

- Cleanup experimental eval APIs ([#171]https://github.com/contextbridge/aether/pull/171)

## [0.2.5]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.4...aether-evals-v0.2.5 - 2026-06-18

### Added

- Improved support for evals ([#167]https://github.com/contextbridge/aether/pull/167)

## [0.2.4]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.3...aether-evals-v0.2.4 - 2026-06-18

### Added

- *(aether-evals)* Drive dockerized agents under eval via ACP ([#161]https://github.com/contextbridge/aether/pull/161)

### Other

- Better experience for authoring evals ([#162]https://github.com/contextbridge/aether/pull/162)

## [0.2.3]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.2...aether-evals-v0.2.3 - 2026-06-13

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.2]https://github.com/contextbridge/aether/compare/aether-evals-v0.2.1...aether-evals-v0.2.2 - 2026-06-13

### Other

- updated the following local packages: aether-llm, aether-agent-core, aether-project

## [0.2.1]https://github.com/contextbridge/aether/releases/tag/aether-evals-v0.2.1 - 2026-06-10

### Added

- *(aether-cli)* Add evals command ([#142]https://github.com/contextbridge/aether/pull/142)

## [aether-evals-v0.2.1] - 2026-04-27