Struct ModelCapabilities 

pub struct ModelCapabilities {
    pub batch_capable: bool,
    pub optimal_batch_size: Option<usize>,
    pub gpu_capable: bool,
    pub gpu_active: bool,
    pub device: Option<String>,
    pub streaming_capable: bool,
    pub recommended_chunk_size: Option<usize>,
    pub relation_capable: bool,
    pub dynamic_labels: bool,
    pub discontinuous_capable: bool,
}

Summary of a model’s capabilities, useful when working with Box<dyn Model>.

Since capability traits (BatchCapable, GpuCapable, etc.) can’t be queried through a Box<dyn Model> without downcasting, this struct provides a static summary of what the model supports.

Example

use anno::{Model, ModelCapabilities};

fn process_with_model(model: &dyn Model) {
    let caps = model.capabilities();

    if caps.batch_capable {
        println!("Model supports batch processing");
    }
    if caps.gpu_capable {
        println!("Model can use GPU: {:?}", caps.device);
    }
}

Fields

batch_capable: bool

True if the model implements BatchCapable.

optimal_batch_size: Option<usize>

Optimal batch size, if batch capable.

gpu_capable: bool

True if the model implements GpuCapable.

gpu_active: bool

True if GPU is currently active.

device: Option<String>

Device identifier (e.g., “cuda:0”, “cpu”), if GPU capable.

streaming_capable: bool

True if the model implements StreamingCapable.

recommended_chunk_size: Option<usize>

Recommended chunk size for streaming, if streaming capable.

relation_capable: bool

True if the model implements RelationCapable.

dynamic_labels: bool

True if the model implements DynamicLabels (zero-shot, caller-supplied entity types).

discontinuous_capable: bool

True if the model can extract discontinuous entities spanning non-adjacent spans. Only W2NER (when loaded with an ONNX session) sets this today.

Trait Implementations

impl Clone for ModelCapabilities

fn clone(&self) -> ModelCapabilities

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelCapabilities

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModelCapabilities

fn default() -> ModelCapabilities

Returns the “default value” for a type.