Struct RuntimeConfig 

pub struct RuntimeConfig {
    pub model_path: PathBuf,
    pub format: ModelFormat,
    pub host: String,
    pub port: u16,
    pub context_size: u32,
    pub batch_size: u32,
    pub threads: u32,
    pub gpu_layers: u32,
    pub runtime_binary: Option<PathBuf>,
    pub extra_config: Value,
}

Runtime configuration for model initialization

Fields

model_path: PathBuf

Path to model file

format: ModelFormat

Model format

host: String

Host for runtime server (e.g., “127.0.0.1”)

port: u16

Port for runtime server (e.g., 8001)

context_size: u32

Context size

batch_size: u32

Batch size

threads: u32

Number of CPU threads

gpu_layers: u32

GPU layers to offload (0 = CPU only)

runtime_binary: Option<PathBuf>

Path to runtime binary (e.g., llama-server.exe)

extra_config: Value

Additional runtime-specific configuration

Trait Implementations

impl Clone for RuntimeConfig

fn clone(&self) -> RuntimeConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RuntimeConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RuntimeConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for RuntimeConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for RuntimeConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.