Docs.rs
llama-runner-1.0.0
llama-runner 1.0.0
Permalink
Docs.rs crate page
Apache-2.0
Links
Homepage
Repository
crates.io
Source
Owners
zhufucdev
Dependencies
encoding_rs ^0.8
normal
hf-hub ^0.5
normal
image ^0.25.10
normal
llama-cpp-2 ^0.1.140
normal
log ^0.4
normal
rand ^0.10
normal
serde ^1.0
normal
strum ^0.28
normal
thiserror ^2.0
normal
tokio ^1.50
normal
Versions
0%
of the crate is documented
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
Skip to main content
Crate llama_runner
llama_
runner
1.0.0
All Items
Crate Items
Modules
Structs
Enums
Constants
Traits
Type Aliases
Crate
llama_
runner
Copy item path
Source
Modules
§
error
sample
Structs
§
Gemma3
Stream
Gemma3
Text
Runner
Gemma3
Vision
Runner
Runner
Request
Runner
With
Recommended
Sampling
Enums
§
Image
OrText
Message
Role
Constants
§
GEMMA_
3_
1B_
GUFF_
MODEL_
FILENAME
GEMMA_
3_
1B_
GUFF_
MODEL_
ID
QWEN_
3D5_
4B_
GUFF_
MODDEL_
FILENAME
QWEN_
3D5_
4B_
GUFF_
MODEL_
ID
QWEN_
3D5_
4B_
GUFF_
MULTIMODEL_
FILENAME
Traits
§
Text
LmRunner
Text
LmRunner
Ext
Vision
LmRunner
Vision
LmRunner
Ext
Type Aliases
§
Text
LmRequest
Vision
LmRequest