Enum LlamaCommand 

pub enum LlamaCommand {
    Start {
        model: PathBuf,
        port: u16,
        ctx_size: usize,
        threads: Option<usize>,
    },
    Stop,
    List {
        server_url: String,
    },
    Status {
        server_url: String,
    },
    Download {
        model: String,
        output: Option<PathBuf>,
    },
}

LLaMA subcommand

Variants

Start

Start llama.cpp server

Fields

model: PathBuf

port: u16

ctx_size: usize

threads: Option<usize>

Stop

Stop llama.cpp server

List

List available models

Fields

server_url: String

Status

Show server status

Fields

server_url: String

Download

Download a model

Fields

model: String

output: Option<PathBuf>

Trait Implementations

impl Debug for LlamaCommand

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.