kproc-llm-0.5.0
- kproc-llm 0.5.0
- Docs.rs crate page
- MIT
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- cyrilleberger
- Dependencies
- ccutils ^0.3 normal
  
  encoding_rs ^0.8 normal optional
  
  futures ^0.3 normal
  
  hf-hub ^0.4 normal optional
  
  kproc-values ^0.5.0 normal optional
  
  llama-cpp-2 =0.1.112 normal optional
  
  llama-cpp-sys-2 =0.1.112 normal optional
  
  log ^0.4 normal
  
  minijinja ^2 normal optional
  
  ollama-rs ^0.3 normal optional
  
  schemars ^1 normal optional
  
  serde ^1 normal optional
  
  serde_json ^1 normal optional
  
  thiserror ^2 normal
  
  yaaral ^0.2 normal optional
  
  colog ^1 dev
  
  tokio ^1 dev
  
  yaaral ^0.2 dev
- Versions
- 100% of the crate is documented
Go to latest version
Platform
Feature flags

docs.rs

Rust

kproc_llm0.5.0

Module simple_api

Module Items

Structs

In crate kproc_llm

Module simple_api

Expand description

Module for using with simple API (like llama-cpp-server).

Structs§

SimpleApi: Simple API.