Struct OllamaPlacement 

pub struct OllamaPlacement {
    pub size_vram_bytes: u64,
    pub total_bytes: u64,
}

Post-turn memory placement of the loaded Ollama model, from /api/ps. total_bytes is weights + KV + buffers; size_vram_bytes is the part resident in VRAM. Volatile (changes when the model reloads), so it lives outside the quasi-static OllamaContextInfo.

Fields

size_vram_bytes: u64

total_bytes: u64

Implementations

impl OllamaPlacement

pub fn offloaded(&self) -> bool

True when the model didn’t fully fit VRAM and spilled to CPU/RAM (slow).

pub fn percent_on_cpu(&self) -> u8

Rough percentage of the model running on CPU/RAM (0–100). Integer math; 0 when the footprint is unknown or fully resident.

Trait Implementations

impl Clone for OllamaPlacement

fn clone(&self) -> OllamaPlacement

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for OllamaPlacement

impl Debug for OllamaPlacement

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for OllamaPlacement

fn default() -> OllamaPlacement

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for OllamaPlacement

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for OllamaPlacement

impl PartialEq for OllamaPlacement

fn eq(&self, other: &OllamaPlacement) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for OllamaPlacement

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for OllamaPlacement