llama-runner-1.0.0
- llama-runner 1.0.0
- Permalink
- Docs.rs crate page
- Apache-2.0
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- zhufucdev
- Dependencies
- encoding_rs ^0.8 normal
  hf-hub ^0.5 normal
  image ^0.25.10 normal
  llama-cpp-2 ^0.1.140 normal
  log ^0.4 normal
  rand ^0.10 normal
  serde ^1.0 normal
  strum ^0.28 normal
  thiserror ^2.0 normal
  tokio ^1.50 normal
- Versions
- 0% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

Crate llama_runner

llama_runner1.0.0

All Items

Crate Items

Modules
Structs
Enums
Constants
Traits
Type Aliases

Crate llama_runner

Modules§

error
sample

Structs§

Gemma3Stream
Gemma3TextRunner
Gemma3VisionRunner
RunnerRequest
RunnerWithRecommendedSampling

Enums§

ImageOrText
MessageRole

Constants§

GEMMA_3_1B_GUFF_MODEL_FILENAME
GEMMA_3_1B_GUFF_MODEL_ID
QWEN_3D5_4B_GUFF_MODDEL_FILENAME
QWEN_3D5_4B_GUFF_MODEL_ID
QWEN_3D5_4B_GUFF_MULTIMODEL_FILENAME

Traits§

TextLmRunner
TextLmRunnerExt
VisionLmRunner
VisionLmRunnerExt

Type Aliases§

TextLmRequest
VisionLmRequest