Struct Node 

pub struct Node {
    pub host: String,
    pub description: Option<String>,
    pub layers: Vec<String>,
    pub vram_bytes: u64,
    pub tflops: f64,
    pub backend: String,
    pub hostname: String,
    pub os: String,
}

A single node (worker).

Fields

host: String

Address and port of the worker.

description: Option<String>

Optional description.

layers: Vec<String>

vram_bytes: u64

Total VRAM (or system RAM) in bytes available on this node.

tflops: f64

Approximate FP16 TFLOPS for this node.

backend: String

Backend description (e.g. “CUDA 12.4”, “Apple M2 Max”, “CPU”).

hostname: String

Hostname of the node.

os: String

Operating system (e.g. “linux”, “macos”, “windows”).

Implementations

impl Node

pub fn is_text_model_layer_owner(&self, full_layer_name: &str) -> bool

Return true if this node hosts the specified layer.

Trait Implementations

impl Clone for Node

fn clone(&self) -> Node

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Node

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Node

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for Node

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.