Re-exports§
pub use llama_cpp_bindings;
Modules§
- agent
- agent_
applicable_ state - agent_
applicable_ state_ holder - agent_
desired_ model - agent_
desired_ state - agent_
issue_ fix - atomic_
value - balancer
- balancer_
applicable_ state - balancer_
applicable_ state_ holder - balancer_
desired_ state - chat_
template_ renderer - continuation_
decision - continuation_
stop_ parameters - controls_
session - controls_
websocket_ endpoint - converts_
to_ applicable_ state - converts_
to_ llama_ kv_ cache_ dtype - converts_
to_ llama_ pooling_ type - create_
cors_ middleware - decoded_
image - decoded_
image_ error - dispenses_
slots - embedding_
input_ tokenized - produces_
snapshot - resolved_
socket_ addr - sends_
rpc_ message - service
- service_
manager - sets_
desired_ state - slot_
aggregated_ status - slot_
aggregated_ status_ download_ progress - slot_
aggregated_ status_ manager - snapshots_
stream - subscribes_
to_ updates - websocket_
session_ controller