Docs.rs
  • llama-core-0.32.15
    • llama-core 0.32.15
    • Permalink
    • Docs.rs crate page
    • Apache-2.0
    • Links
    • Documentation
    • Repository
    • crates.io
    • Source
    • Owners
    • apepkuss
    • Dependencies
      • base64 =0.22.1 normal
      • bitflags ^2.0 normal
      • chat-prompts ^0.31 normal
      • either ^1.12.0 normal
      • endpoints ^0.33 normal
      • futures ^0.3.6 normal
      • log ^0.4.21 normal optional
      • once_cell ^1.18 normal
      • qdrant_rest_client ^0.2.1 normal optional
      • regex ^1 normal
      • reqwest ^0.11 normal
      • serde ^1.0 normal
      • serde_json ^1.0 normal
      • text-splitter ^0.7 normal
      • thiserror ^1 normal
      • tiktoken-rs ^0.5 normal
      • tokio ^1.36 normal
      • uuid ^1.4 normal
      • walkdir ^2.5.0 normal
      • wasi-logger ^0.1.2 normal optional
      • wasmedge-wasi-nn ^0.8.0 normal
      • wasmedge_stable_diffusion =0.3.2 normal
    • Versions
    • 57.19% of the crate is documented
  • Platform
    • i686-unknown-linux-gnu
    • x86_64-unknown-linux-gnu
  • Feature flags
  • docs.rs
    • About docs.rs
    • Privacy policy
  • Rust
    • Rust website
    • The Book
    • Standard Library API Reference
    • Rust by Example
    • The Cargo Guide
    • Clippy Documentation

Crate llama_core

llama_core0.32.15

  • All Items

Crate Items

  • Re-exports
  • Modules
  • Structs
  • Enums
  • Constants
  • Functions

Crates

  • llama_core

Crate llama_core

Source
Expand description

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Re-exports§

pub use error::LlamaCoreError;
pub use graph::EngineType;
pub use graph::Graph;
pub use graph::GraphBuilder;
pub use metadata::ggml::GgmlMetadata;
pub use metadata::ggml::GgmlTtsMetadata;
pub use metadata::piper::PiperMetadata;
pub use metadata::BaseMetadata;

Modules§

audio
chat
Define APIs for chat completion.
completions
Define APIs for completions.
embeddings
Define APIs for computing embeddings.
error
Error types for the Llama Core library.
files
Define APIs for file operations.
graph
Define Graph and GraphBuilder APIs for creating a new computation graph.
images
Define APIs for image generation and edit.
metadata
Define the types for model metadata.
models
Define APIs for querying models.
ragrag
Define APIs for RAG operations.
searchsearch
Define APIs for web search operations.
tts
utils
Define utility functions.

Structs§

PluginInfo
Version info of the wasi-nn_ggml plugin, including the build number and the commit id.

Enums§

StableDiffusionTask
The task type of the stable diffusion context

Constants§

ARCHIVES_DIR
The directory for storing the archives in wasm virtual file system.

Functions§

get_plugin_info
Get the plugin info
init_ggml_chat_context
Initialize the ggml context
init_ggml_embeddings_context
Initialize the ggml context
init_ggml_rag_contextrag
Initialize the ggml context for RAG scenarios.
init_ggml_tts_context
Initialize the ggml context for TTS scenarios.
init_piper_context
Initialize the piper context
init_sd_context_with_full_model
Initialize the stable-diffusion context with the given full diffusion model
init_sd_context_with_standalone_model
Initialize the stable-diffusion context with the given standalone diffusion model
init_whisper_contextwhisper
Initialize the whisper context
running_mode
Return the current running mode.

Results

Settings
Help
    module
    llama_core::files
    Define APIs for file operations.
    function
    llama_core::files::list_files
    List all files in the archives directory.
    method
    llama_core::graph::GraphBuilder::build_from_files
No results :(
Try on DuckDuckGo?

Or try looking in one of these:
  • The Rust Reference for technical details about the language.
  • Rust By Example for expository code examples.
  • The Rust Book for introductions to language features and the language itself.
  • Docs.rs for documentation of crates released on crates.io.
No results :(
Try on DuckDuckGo?

Or try looking in one of these:
  • The Rust Reference for technical details about the language.
  • Rust By Example for expository code examples.
  • The Rust Book for introductions to language features and the language itself.
  • Docs.rs for documentation of crates released on crates.io.