agentic-eval 0.14.4

Evaluate programs, CLI commands, programming languages, AI frameworks, and VM/sandbox systems for agentic AI use across four axes — token efficiency, determinism, reliability, and safety — under popular tokenizers (OpenAI GPT-4/GPT-4o, Anthropic Claude). Includes a CLI effect classifier, curated language/framework/VM profiles, and a self-describing ontology.

Build #3985628 2026-07-29 17:58:39

Build failed. If you want to re-trigger a documentation build, you can do it here. You can find more information on docs.rs builds documentation on the builds page.

# error kind ExecutionFailed

# pre-build errors command failed: exit status: 101

# rustc version rustc 1.99.0-nightly (d0babd8b6 2026-07-15)

# docs.rs version docsrs 0.0.0 (f1b150f0cd76f7cabcd39e1f4790ba771b28b5c4 2026-07-19 )

# build log [INFO] running `Command { std: "docker" "exec" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "DOCS_RS=1" "-w" "/opt/rustwide/workdir" "--user" "1001:1001" "bdb6a632ada4e5d08c41dc28946ce28df7b272e5eda7dea7d0e6d861c536e5be" "/opt/rustwide/cargo-home/bin/cargo" "+nightly-2026-07-16" "rustdoc" "--lib" "-Zrustdoc-map" "--all-features" "--config" "build.rustdocflags=[\"--cfg\", \"docsrs\", \"-Z\", \"unstable-options\", \"--emit=html-non-static-files\", \"--resource-suffix\", \"-20260715-1.99.0-nightly-d0babd8b6\", \"--static-root-path\", \"/-/rustdoc.static/\", \"--cap-lints\", \"warn\", \"--extern-html-root-takes-precedence\"]" "--offline" "-Zunstable-options" "--config=doc.extern-map.registries.crates-io=\"https://docs.rs/{pkg_name}/{version}/x86_64-unknown-linux-gnu\"" "-Zrustdoc-scrape-examples" "-j6" "--target" "x86_64-unknown-linux-gnu", kill_on_drop: false }` [INFO] [stderr] Scraping agentic-eval v0.14.4 (/opt/rustwide/workdir) [INFO] [stderr] Documenting agentic-eval v0.14.4 (/opt/rustwide/workdir) [INFO] [stderr] warning: unresolved link to `Decision` [INFO] [stderr] --> src/ontology.rs:8:71 [INFO] [stderr] | [INFO] [stderr] 8 | //! its four [axes](crate), the [`Effect`] taxonomy with the policy [`Decision`] each [INFO] [stderr] | ^^^^^^^^ no item named `Decision` in scope [INFO] [stderr] | [INFO] [stderr] = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]` [INFO] [stderr] = note: `#[warn(rustdoc::broken_intra_doc_links)]` on by default [INFO] [stderr] [INFO] [stderr] warning: unresolved link to `Policy` [INFO] [stderr] --> src/safety.rs:7:50 [INFO] [stderr] | [INFO] [stderr] 7 | //! applies a default-deny-for-dangerous agent [`Policy`], and scores how much of [INFO] [stderr] | ^^^^^^ no item named `Policy` in scope [INFO] [stderr] | [INFO] [stderr] = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]` [INFO] [stderr] [INFO] [stderr] warning: `ontology` is both a function and a module [INFO] [stderr] --> src/lib.rs:26:41 [INFO] [stderr] | [INFO] [stderr] 26 | //! with optional `serde`), and — via [`ontology`] — *self-describing*. A consumer [INFO] [stderr] | ^^^^^^^^ ambiguous link [INFO] [stderr] | [INFO] [stderr] help: to link to the function, add parentheses [INFO] [stderr] | [INFO] [stderr] 26 | //! with optional `serde`), and — via [`ontology()`] — *self-describing*. A consumer [INFO] [stderr] | ++ [INFO] [stderr] help: to link to the module, prefix with `mod@` [INFO] [stderr] | [INFO] [stderr] 26 | //! with optional `serde`), and — via [`mod@ontology`] — *self-describing*. A consumer [INFO] [stderr] | ++++ [INFO] [stderr] [INFO] [stderr] warning: `crate::ontology` is both a function and a module [INFO] [stderr] --> src/commands.rs:280:33 [INFO] [stderr] | [INFO] [stderr] 280 | /// Exposed so the [`ontology`](crate::ontology) can describe what each effect class [INFO] [stderr] | ^^^^^^^^^^^^^^^ ambiguous link [INFO] [stderr] | [INFO] [stderr] help: to link to the function, add parentheses [INFO] [stderr] | [INFO] [stderr] 280 | /// Exposed so the [`ontology`](crate::ontology()) can describe what each effect class [INFO] [stderr] | ++ [INFO] [stderr] help: to link to the module, prefix with `mod@` [INFO] [stderr] | [INFO] [stderr] 280 | /// Exposed so the [`ontology`](mod@crate::ontology) can describe what each effect class [INFO] [stderr] | ++++ [INFO] [stderr] [INFO] [stderr] [INFO] [stderr] thread 'rustc' (1928) panicked at src/librustdoc/html/highlight.rs:234:42: [INFO] [stderr] `exit_elem` called on empty class stack parent [INFO] [stderr] stack backtrace: [INFO] [stderr] 0: 0x7f5b9b843416 - <<std[5264d755c47072bd]::sys::backtrace::BacktraceLock>::print::DisplayBacktrace as core[435d43ddfce3abfa]::fmt::Display>::fmt [INFO] [stderr] 1: 0x7f5b9be0ec88 - core[435d43ddfce3abfa]::fmt::write [INFO] [stderr] 2: 0x7f5b9b85867c - <std[5264d755c47072bd]::sys::stdio::unix::Stderr as core[435d43ddfce3abfa]::io::write::Write>::write_fmt [INFO] [stderr] 3: 0x7f5b9b81558a - std[5264d755c47072bd]::panicking::default_hook::{closure#0} [INFO] [stderr] 4: 0x7f5b9b835b33 - std[5264d755c47072bd]::panicking::default_hook [INFO] [stderr] 5: 0x7f5b9a7f84bb - std[5264d755c47072bd]::panicking::update_hook::<alloc[3370a9fffbfbb078]::boxed::Box<rustc_driver_impl[1a0cb5a41f716c7a]::install_ice_hook::{closure#1}>>::{closure#0} [INFO] [stderr] 6: 0x7f5b9b835fd2 - std[5264d755c47072bd]::panicking::panic_with_hook [INFO] [stderr] 7: 0x7f5b9b815642 - std[5264d755c47072bd]::panicking::panic_handler::{closure#0} [INFO] [stderr] 8: 0x7f5b9b80dfc9 - std[5264d755c47072bd]::sys::backtrace::__rust_end_short_backtrace::<std[5264d755c47072bd]::panicking::panic_handler::{closure#0}, !> [INFO] [stderr] 9: 0x7f5b9b816f9d - __rustc[efc60ea9c7e5e02b]::rust_begin_unwind [INFO] [stderr] 10: 0x7f5b9853c8ec - core[435d43ddfce3abfa]::panicking::panic_fmt [INFO] [stderr] 11: 0x7f5b995fe034 - core[435d43ddfce3abfa]::option::expect_failed [INFO] [stderr] 12: 0x55e565027672 - rustdoc[6b9d1e02e669310a]::html::highlight::write_code::<core[435d43ddfce3abfa]::fmt::Formatter>::{closure#2} [INFO] [stderr] 13: 0x55e565162d66 - rustdoc[6b9d1e02e669310a]::html::highlight::classify [INFO] [stderr] 14: 0x55e564f7600b - rustdoc[6b9d1e02e669310a]::html::highlight::write_code::<core[435d43ddfce3abfa]::fmt::Formatter> [INFO] [stderr] 15: 0x55e56521b15a - <&core[435d43ddfce3abfa]::fmt::builders::FromFn<rustdoc[6b9d1e02e669310a]::html::sources::print_src<&mut core[435d43ddfce3abfa]::fmt::Formatter>::{closure#0}> as core[435d43ddfce3abfa]::fmt::Display>::fmt [INFO] [stderr] 16: 0x7f5b9be0ec88 - core[435d43ddfce3abfa]::fmt::write [INFO] [stderr] 17: 0x55e56521b591 - <&askama[d3bb9aff3e29703a]::filters::escape::Safe<&core[435d43ddfce3abfa]::fmt::builders::FromFn<rustdoc[6b9d1e02e669310a]::html::sources::print_src<&mut core[435d43ddfce3abfa]::fmt::Formatter>::{closure#0}>> as core[435d43ddfce3abfa]::fmt::Display>::fmt [INFO] [stderr] 18: 0x7f5b9be0ec88 - core[435d43ddfce3abfa]::fmt::write [INFO] [stderr] 19: 0x55e56502631c - rustdoc[6b9d1e02e669310a]::html::render::render_call_locations::<&mut core[435d43ddfce3abfa]::fmt::Formatter>::{closure#2} [INFO] [stderr] 20: 0x55e56524bf13 - <core[435d43ddfce3abfa]::fmt::builders::FromFn<rustdoc[6b9d1e02e669310a]::html::render::document_full_inner::{closure#0}> as core[435d43ddfce3abfa]::fmt::Display>::fmt [INFO] [stderr] 21: 0x55e564ed861f - rustdoc[6b9d1e02e669310a]::html::render::render_impl::{closure#0}::doc_impl_item::<&mut alloc[3370a9fffbfbb078]::string::String, &mut alloc[3370a9fffbfbb078]::string::String> [INFO] [stderr] 22: 0x55e5650468cc - rustdoc[6b9d1e02e669310a]::html::render::render_impl::{closure#0} [INFO] [stderr] 23: 0x55e56515d0e8 - rustdoc[6b9d1e02e669310a]::html::render::render_assoc_items_inner [INFO] [stderr] 24: 0x55e56524b784 - <core[435d43ddfce3abfa]::fmt::builders::FromFn<rustdoc[6b9d1e02e669310a]::html::render::render_assoc_items::{closure#0}> as core[435d43ddfce3abfa]::fmt::Display>::fmt [INFO] [stderr] 25: 0x7f5b9be0ec88 - core[435d43ddfce3abfa]::fmt::write [INFO] [stderr] 26: 0x55e564eb004c - <rustdoc[6b9d1e02e669310a]::html::render::print_item::DisplayStruct>::render_into::<core[435d43ddfce3abfa]::fmt::Formatter> [INFO] [stderr] 27: 0x55e565250050 - <core[435d43ddfce3abfa]::fmt::builders::FromFn<rustdoc[6b9d1e02e669310a]::html::render::print_item::item_struct::{closure#0}> as core[435d43ddfce3abfa]::fmt::Display>::fmt [INFO] [stderr] 28: 0x7f5b9be0ec88 - core[435d43ddfce3abfa]::fmt::write [INFO] [stderr] 29: 0x55e5650a405b - <rustdoc[6b9d1e02e669310a]::html::render::context::Context>::render_item [INFO] [stderr] 30: 0x55e56523aa7e - <rustdoc[6b9d1e02e669310a]::html::render::context::Context as rustdoc[6b9d1e02e669310a]::formats::renderer::FormatRenderer>::item [INFO] [stderr] 31: 0x55e564f787d2 - rustdoc[6b9d1e02e669310a]::formats::renderer::run_format_inner::<rustdoc[6b9d1e02e669310a]::html::render::context::Context> [INFO] [stderr] 32: 0x55e564f7896a - rustdoc[6b9d1e02e669310a]::formats::renderer::run_format_inner::<rustdoc[6b9d1e02e669310a]::html::render::context::Context> [INFO] [stderr] 33: 0x55e564f7896a - rustdoc[6b9d1e02e669310a]::formats::renderer::run_format_inner::<rustdoc[6b9d1e02e669310a]::html::render::context::Context> [INFO] [stderr] 34: 0x55e56502c7e3 - rustdoc[6b9d1e02e669310a]::main_args::{closure#2}::{closure#0} [INFO] [stderr] 35: 0x55e5650233c7 - rustc_interface[9dfee8ea86d2ddde]::interface::run_compiler::<(), rustdoc[6b9d1e02e669310a]::main_args::{closure#2}>::{closure#1} [INFO] [stderr] 36: 0x55e564f72718 - std[5264d755c47072bd]::sys::backtrace::__rust_begin_short_backtrace::<rustc_interface[9dfee8ea86d2ddde]::util::run_in_thread_with_globals<rustc_interface[9dfee8ea86d2ddde]::util::run_in_thread_pool_with_globals<rustc_interface[9dfee8ea86d2ddde]::interface::run_compiler<(), rustdoc[6b9d1e02e669310a]::main_args::{closure#2}>::{closure#1}, ()>::{closure#0}, ()>::{closure#0}::{closure#0}, ()> [INFO] [stderr] 37: 0x55e565062d7d - <std[5264d755c47072bd]::thread::lifecycle::spawn_unchecked<rustc_interface[9dfee8ea86d2ddde]::util::run_in_thread_with_globals<rustc_interface[9dfee8ea86d2ddde]::util::run_in_thread_pool_with_globals<rustc_interface[9dfee8ea86d2ddde]::interface::run_compiler<(), rustdoc[6b9d1e02e669310a]::main_args::{closure#2}>::{closure#1}, ()>::{closure#0}, ()>::{closure#0}::{closure#0}, ()>::{closure#1} as core[435d43ddfce3abfa]::ops::function::FnOnce<()>>::call_once::{shim:vtable#0} [INFO] [stderr] 38: 0x7f5b9d015e90 - <std[5264d755c47072bd]::sys::thread::unix::Thread>::new::thread_start [INFO] [stderr] 39: 0x7f5b96a830da - <unknown> [INFO] [stderr] 40: 0x7f5b96b165b4 - clone [INFO] [stderr] 41: 0x0 - <unknown> [INFO] [stderr] [INFO] [stderr] error: the compiler unexpectedly panicked. This is a bug [INFO] [stderr] [INFO] [stderr] note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-rustdoc&template=ice.md [INFO] [stderr] [INFO] [stderr] note: please make sure that you have updated to the latest nightly [INFO] [stderr] [INFO] [stderr] warning: the ICE couldn't be written to `/opt/rustwide/workdir/rustc-ice-2026-07-29T17_58_39-1927.txt`: Read-only file system (os error 30) [INFO] [stderr] [INFO] [stderr] note: rustc 1.99.0-nightly (d0babd8b6 2026-07-15) running on x86_64-unknown-linux-gnu [INFO] [stderr] [INFO] [stderr] note: compiler flags: --crate-type lib -Z unstable-options -Z unstable-options -Z unstable-options [INFO] [stderr] [INFO] [stderr] note: some of the compiler flags provided by cargo are hidden [INFO] [stderr] [INFO] [stderr] query stack during panic: [INFO] [stderr] end of query stack [INFO] [stderr] warning: `agentic-eval` (lib doc) generated 4 warnings [INFO] [stderr] error: could not document `agentic-eval` [INFO] running `Command { std: "docker" "inspect" "bdb6a632ada4e5d08c41dc28946ce28df7b272e5eda7dea7d0e6d861c536e5be", kill_on_drop: false }`