llama_cpp 0.3.2

High-level bindings to llama.cpp with a focus on just being really, really easy to use
Documentation
Build #2100466 2025-05-11 09:37:19
# rustc version
rustc 1.89.0-nightly (7b84c9e9c 2025-05-10)# docs.rs version
docsrs 0.6.0 (f7595057 2025-05-09)# build log
[INFO] running `Command { std: "docker" "create" "-v" "/home/cratesfyi/workspace/builds/llama_cpp-0.3.2/target:/opt/rustwide/target:rw,Z" "-v" "/home/cratesfyi/workspace/builds/llama_cpp-0.3.2/source:/opt/rustwide/workdir:ro,Z" "-v" "/home/cratesfyi/workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/home/cratesfyi/workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "DOCS_RS=1" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "6442450944" "--cpus" "6" "--user" "1001:1001" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:b0b074c097205a61b89e8ad263052f976b2b332c4dc5f02aef1fe52501660d6e" "/opt/rustwide/cargo-home/bin/cargo" "+nightly" "rustdoc" "--lib" "-Zrustdoc-map" "--config" "build.rustdocflags=[\"--cfg\", \"docsrs\", \"-Z\", \"unstable-options\", \"--emit=invocation-specific\", \"--resource-suffix\", \"-20250510-1.89.0-nightly-7b84c9e9c\", \"--static-root-path\", \"/-/rustdoc.static/\", \"--cap-lints\", \"warn\", \"--extern-html-root-takes-precedence\"]" "--offline" "-Zunstable-options" "--config=doc.extern-map.registries.crates-io=\"https://docs.rs/{pkg_name}/{version}/x86_64-unknown-linux-gnu\"" "-Zrustdoc-scrape-examples" "-j6" "--target" "x86_64-unknown-linux-gnu", kill_on_drop: false }`
[INFO] [stderr] WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
[INFO] [stdout] dbc6121ebac502924ba7cd5be8b1712b58ee1eaa01d69ccee8beed2558f7b9ec
[INFO] running `Command { std: "docker" "start" "-a" "dbc6121ebac502924ba7cd5be8b1712b58ee1eaa01d69ccee8beed2558f7b9ec", kill_on_drop: false }`
[INFO] [stderr] warning: target filter specified, but no targets matched; this is a no-op
[INFO] [stderr]  Documenting llama_cpp v0.3.2 (/opt/rustwide/workdir)
[INFO] [stderr] warning: unresolved link to `llama_split_mode_LLAMA_SPLIT_NONE`
[INFO] [stderr]   --> src/model/params.rs:50:25
[INFO] [stderr]    |
[INFO] [stderr] 50 |     /// Equivalent to [`llama_split_mode_LLAMA_SPLIT_NONE`]
[INFO] [stderr]    |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ no item named `llama_split_mode_LLAMA_SPLIT_NONE` in scope
[INFO] [stderr]    |
[INFO] [stderr]    = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stderr]    = note: `#[warn(rustdoc::broken_intra_doc_links)]` on by default
[INFO] [stderr] 
[INFO] [stderr] warning: unresolved link to `llama_split_mode_LLAMA_SPLIT_LAYER`
[INFO] [stderr]   --> src/model/params.rs:55:25
[INFO] [stderr]    |
[INFO] [stderr] 55 |     /// Equivalent to [`llama_split_mode_LLAMA_SPLIT_LAYER`]
[INFO] [stderr]    |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ no item named `llama_split_mode_LLAMA_SPLIT_LAYER` in scope
[INFO] [stderr]    |
[INFO] [stderr]    = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stderr] 
[INFO] [stderr] warning: unresolved link to `llama_split_mode_LLAMA_SPLIT_ROW`
[INFO] [stderr]   --> src/model/params.rs:60:25
[INFO] [stderr]    |
[INFO] [stderr] 60 |     /// Equivalent to [`llama_split_mode_LLAMA_SPLIT_ROW`]
[INFO] [stderr]    |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ no item named `llama_split_mode_LLAMA_SPLIT_ROW` in scope
[INFO] [stderr]    |
[INFO] [stderr]    = help: to escape `[` and `]` characters, add '\' before them like `\[` or `\]`
[INFO] [stderr] 
[INFO] [stderr] warning: unresolved link to `CompletionHandle::into_string_completion`
[INFO] [stderr]    --> src/session/completion.rs:212:11
[INFO] [stderr]     |
[INFO] [stderr] 212 | /// See [`CompletionHandle::into_string_completion`] for more information.
[INFO] [stderr]     |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the struct `CompletionHandle` has no field or associated item named `into_string_completion`
[INFO] [stderr] 
[INFO] [stderr] warning: this URL is not a hyperlink
[INFO] [stderr]    --> src/session/params.rs:246:14
[INFO] [stderr]     |
[INFO] [stderr] 246 |     /// ref: https://github.com/ggerganov/llama.cpp/pull/2054
[INFO] [stderr]     |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr]     |
[INFO] [stderr]     = note: bare URLs are not automatically turned into clickable links
[INFO] [stderr]     = note: `#[warn(rustdoc::bare_urls)]` on by default
[INFO] [stderr] help: use an automatic link instead
[INFO] [stderr]     |
[INFO] [stderr] 246 |     /// ref: <https://github.com/ggerganov/llama.cpp/pull/2054>
[INFO] [stderr]     |              +                                                +
[INFO] [stderr] 
[INFO] [stderr] warning: `llama_cpp` (lib doc) generated 5 warnings (run `cargo fix --lib -p llama_cpp` to apply 1 suggestion)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.59s
[INFO] [stderr]    Generated /opt/rustwide/target/x86_64-unknown-linux-gnu/doc/llama_cpp/index.html
[INFO] running `Command { std: "docker" "inspect" "dbc6121ebac502924ba7cd5be8b1712b58ee1eaa01d69ccee8beed2558f7b9ec", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "dbc6121ebac502924ba7cd5be8b1712b58ee1eaa01d69ccee8beed2558f7b9ec", kill_on_drop: false }`
[INFO] [stdout] dbc6121ebac502924ba7cd5be8b1712b58ee1eaa01d69ccee8beed2558f7b9ec