Crate lancor 

Modules

bench

Model benchmarking suite for llama.cpp GGUF models.

hub

HuggingFace Hub client — download GGUF models directly from HF.

server

llama.cpp binary orchestration — manage llama-server and CLI tools.

Structs

ChatChoice

ChatChoiceDelta

ChatCompletionChunk

ChatCompletionRequest

ChatCompletionResponse

CompletionRequest

CompletionResponse

Delta

EmbeddingData

EmbeddingRequest

EmbeddingResponse

LlamaCppClient

Message

Usage