Skip to main content

Module llama_cpp

llm::providers::local

Module llama_cpp 

Source
Expand description

LlamaCpp LLM provider.

This provider accepts any model name at runtime (e.g. llamacpp:my-model). No API key is required.

Structsยง

LlamaCppProvider