llama_cpp 0.3.2

High-level bindings to llama.cpp with a focus on just being really, really easy to use
Documentation
Build #1892163 2025-03-21 01:06:41
# rustc version
rustc 1.87.0-nightly (1aeb99d24 2025-03-19)# docs.rs version
docsrs 0.6.0 (004a02c4 2025-03-05)# build log
[INFO] running `Command { std: "docker" "create" "-v" "/home/cratesfyi/workspace-builder/builds/llama_cpp-0.3.2/target:/opt/rustwide/target:rw,Z" "-v" "/home/cratesfyi/workspace-builder/builds/llama_cpp-0.3.2/source:/opt/rustwide/workdir:ro,Z" "-v" "/home/cratesfyi/workspace-builder/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/home/cratesfyi/workspace-builder/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "DOCS_RS=1" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "6442450944" "--cpus" "6" "--user" "1001:1001" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:4b26683ee3c49f365255c425c23003cbf4366de097804722c29c5bbbee3624d2" "/opt/rustwide/cargo-home/bin/cargo" "+nightly" "rustdoc" "--lib" "-Zrustdoc-map" "--config" "build.rustdocflags=[\"--cfg\", \"docsrs\", \"-Z\", \"unstable-options\", \"--emit=invocation-specific\", \"--resource-suffix\", \"-20250319-1.87.0-nightly-1aeb99d24\", \"--static-root-path\", \"/-/rustdoc.static/\", \"--cap-lints\", \"warn\", \"--extern-html-root-takes-precedence\"]" "--offline" "-Zunstable-options" "--config=doc.extern-map.registries.crates-io=\"https://docs.rs/{pkg_name}/{version}/x86_64-unknown-linux-gnu\"" "-Zrustdoc-scrape-examples" "-j6" "--target" "x86_64-unknown-linux-gnu", kill_on_drop: false }`
[INFO] [stdout] afb90c7839edd3e5deb41d57ed8de26c73fe97141c07c2989d9bc10ea903e2c5
[INFO] [stderr] WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
[INFO] running `Command { std: "docker" "start" "-a" "afb90c7839edd3e5deb41d57ed8de26c73fe97141c07c2989d9bc10ea903e2c5", kill_on_drop: false }`
[INFO] [stderr] warning: target filter specified, but no targets matched; this is a no-op
[INFO] [stderr]  Documenting llama_cpp v0.3.2 (/opt/rustwide/workdir)
[INFO] [stderr] warning: unresolved link to `llama_split_mode_LLAMA_SPLIT_NONE`
[INFO] [stderr]   --> src/model/params.rs:50:25
[INFO] [stderr]    |
[INFO] [stderr] 50 |     /// Equivalent to [`llama_split_mode_LLAMA_SPLIT_NONE`]
[INFO] [stderr]    |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ no item named `llama_split_mode_LLAMA_SPLIT_NONE` in scope
[INFO] [stderr]    |
[INFO] [stderr]    = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stderr]    = note: `#[warn(rustdoc::broken_intra_doc_links)]` on by default
[INFO] [stderr] 
[INFO] [stderr] warning: unresolved link to `llama_split_mode_LLAMA_SPLIT_LAYER`
[INFO] [stderr]   --> src/model/params.rs:55:25
[INFO] [stderr]    |
[INFO] [stderr] 55 |     /// Equivalent to [`llama_split_mode_LLAMA_SPLIT_LAYER`]
[INFO] [stderr]    |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ no item named `llama_split_mode_LLAMA_SPLIT_LAYER` in scope
[INFO] [stderr]    |
[INFO] [stderr]    = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stderr] 
[INFO] [stderr] warning: unresolved link to `llama_split_mode_LLAMA_SPLIT_ROW`
[INFO] [stderr]   --> src/model/params.rs:60:25
[INFO] [stderr]    |
[INFO] [stderr] 60 |     /// Equivalent to [`llama_split_mode_LLAMA_SPLIT_ROW`]
[INFO] [stderr]    |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ no item named `llama_split_mode_LLAMA_SPLIT_ROW` in scope
[INFO] [stderr]    |
[INFO] [stderr]    = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stderr] 
[INFO] [stderr] warning: unresolved link to `CompletionHandle::into_string_completion`
[INFO] [stderr]    --> src/session/completion.rs:212:11
[INFO] [stderr]     |
[INFO] [stderr] 212 | /// See [`CompletionHandle::into_string_completion`] for more information.
[INFO] [stderr]     |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the struct `CompletionHandle` has no field or associated item named `into_string_completion`
[INFO] [stderr] 
[INFO] [stderr] warning: this URL is not a hyperlink
[INFO] [stderr]    --> src/session/params.rs:246:14
[INFO] [stderr]     |
[INFO] [stderr] 246 |     /// ref: https://github.com/ggerganov/llama.cpp/pull/2054
[INFO] [stderr]     |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr]     |
[INFO] [stderr]     = note: bare URLs are not automatically turned into clickable links
[INFO] [stderr]     = note: `#[warn(rustdoc::bare_urls)]` on by default
[INFO] [stderr] help: use an automatic link instead
[INFO] [stderr]     |
[INFO] [stderr] 246 |     /// ref: <https://github.com/ggerganov/llama.cpp/pull/2054>
[INFO] [stderr]     |              +                                                +
[INFO] [stderr] 
[INFO] [stderr] warning: `llama_cpp` (lib doc) generated 5 warnings (run `cargo fix --lib -p llama_cpp` to apply 1 suggestion)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.54s
[INFO] [stderr]    Generated /opt/rustwide/target/x86_64-unknown-linux-gnu/doc/llama_cpp/index.html
[INFO] running `Command { std: "docker" "inspect" "afb90c7839edd3e5deb41d57ed8de26c73fe97141c07c2989d9bc10ea903e2c5", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "afb90c7839edd3e5deb41d57ed8de26c73fe97141c07c2989d9bc10ea903e2c5", kill_on_drop: false }`
[INFO] [stdout] afb90c7839edd3e5deb41d57ed8de26c73fe97141c07c2989d9bc10ea903e2c5