Struct MemoryEstimate 

pub struct MemoryEstimate {
    pub model_weights_bytes: u64,
    pub kv_cache_bytes: u64,
    pub runtime_overhead_bytes: u64,
    pub total_bytes: u64,
    pub fits_in_memory: bool,
}

Memory usage estimate for model inference.

Example

use pictor_runtime::convenience::estimate_memory_requirements;

let est = estimate_memory_requirements(
    1_000_000_000, // 1 GB model
    4096,          // max sequence length
    8,             // KV heads
    128,           // head dim
    36,            // layers
);
assert!(est.total_bytes > est.model_weights_bytes);
assert!(est.fits_in_memory);

Fields

model_weights_bytes: u64

Memory required for model weights.

kv_cache_bytes: u64

Memory required for KV cache.

runtime_overhead_bytes: u64

Estimated runtime overhead (buffers, activations, etc.).

total_bytes: u64

Total estimated memory requirement.

fits_in_memory: bool

Whether the model fits in available memory (heuristic check).

Trait Implementations

impl Clone for MemoryEstimate

fn clone(&self) -> MemoryEstimate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MemoryEstimate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.