Struct ModelEntry 

pub struct ModelEntry {
    pub config: Qwen3Config,
    pub model_path: Option<String>,
    pub loaded_at: Instant,
    pub last_used: Instant,
    pub use_count: u64,
    pub memory_bytes: usize,
}

A single cached model entry, storing metadata about a loaded model.

The entry does not own the actual weight tensors; those live in the InferenceEngine that the cache manages externally. The entry tracks usage statistics so that the cache can decide which entries to evict.

Fields

config: Qwen3Config

Model configuration extracted from GGUF metadata.

model_path: Option<String>

Filesystem path to the GGUF file (if known).

loaded_at: Instant

Wall-clock time at which this entry was first inserted.

last_used: Instant

Wall-clock time of the most recent cache hit for this entry.

use_count: u64

Cumulative number of times this entry has been returned from the cache.

memory_bytes: usize

Estimated resident-memory footprint of the loaded model.

Implementations

impl ModelEntry

pub fn new( config: Qwen3Config, model_path: Option<String>, memory_bytes: usize, ) -> Self

Create a new entry stamped with the current time.

pub fn age(&self) -> Duration

How long this entry has been in the cache.

pub fn idle_time(&self) -> Duration

How long since this entry was last accessed.

pub fn is_stale(&self, ttl: Duration) -> bool

Whether this entry has been idle for longer than ttl.