Struct CortiqRuntime 

pub struct CortiqRuntime { /* private fields */ }

Main runtime managing model state, active task, and metrics.

Implementations

impl CortiqRuntime

pub fn new(model: Arc<CmfModel>) -> Self

Create a new runtime from a loaded CMF model.

pub async fn switch_task(&self, task_name: &str) -> Result<SwitchResult, Error>

Switch to a different task mask.

pub async fn status(&self) -> RuntimeStatus

Get current runtime status.

pub fn masks(&self) -> &MaskCatalog

Get mask catalog.

pub fn model(&self) -> &CmfModel

Get model reference.

pub async fn active_mask(&self) -> Option<TaskMask>

Snapshot of the currently active task mask (None = dense).

pub async fn record_generation( &self, gen_tokens: usize, elapsed_ms: f64, ttft_ms: f64, )

Record a finished generation into the performance metrics.