Struct AllocatedResources 

pub struct AllocatedResources {
    pub kv_cache_blocks: Vec<BlockId>,
    pub gpu_memory: u64,
    pub cpu_memory: u64,
    pub compute_units: usize,
}

Allocated resources for a request

Fields

kv_cache_blocks: Vec<BlockId>

KV cache blocks allocated

gpu_memory: u64

GPU memory allocated (bytes)

cpu_memory: u64

CPU memory allocated (bytes)

compute_units: usize

Compute units reserved

Trait Implementations

impl Clone for AllocatedResources

fn clone(&self) -> AllocatedResources

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AllocatedResources

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AllocatedResources

fn default() -> AllocatedResources

Returns the “default value” for a type.