eval-magic 0.5.0

One-stop CLI for running skill evals — measure whether an agent skill actually shifts behavior.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42

//! The harness adapter layer.
//!
//! [`harness`] defines the [`HarnessAdapter`] trait — the single API generic
//! dispatch code uses to reach harness-specific behavior. Each harness's
//! declarative half lives in its embedded descriptor file
//! (`harnesses/<label>.toml`, loaded by [`descriptor`] and served through the
//! generic [`descriptor_adapter`]); the code-backed features a descriptor
//! references by name live in [`capabilities`], backed by the per-harness
//! module trees ([`claude_code`], [`codex`], [`opencode`]): transcript
//! parsers, plugin-shadow detection, slug sanitization. The write guard is
//! pure descriptor data rendered by the generic engine in [`guard`].
//! The [`registry`] loads the descriptors into label-keyed entries and owns
//! harness-identifier resolution; generic code resolves an adapter with
//! [`adapter_for`] and calls the trait.

pub mod capabilities;
pub mod claude_code;
mod cli_command;
pub mod codex;
pub mod descriptor;
pub mod descriptor_adapter;
pub mod extract;
pub(crate) mod guard;
pub mod harness;
pub mod opencode;
pub mod registry;
pub mod skill_shadow;
mod skills_block;
pub mod transcript;

pub use harness::{
    CliDispatchContext, CliJudgeContext, CliManifestContext, HarnessAdapter, RUNBOOK_TEMPLATE,
    ToolVocabulary,
};
pub use registry::{
    DEFAULT_HARNESS_NAME, UnknownHarnessError, adapter_for, all_config_dir_names,
    all_tool_vocabulary,
};
pub use skill_shadow::{
    PluginShadowReport, ShadowSource, format_shadow_banner, shadow_validity_warnings,
};
pub use transcript::TranscriptSummary;