Struct Capabilities 

pub struct Capabilities {
    pub completion: ProviderCapabilities,
    pub max_documents: usize,
    pub ndims: usize,
    pub declared: Option<usize>,
}

What a runtime accounts for about a model. Each field matters to the operations that name it and is left at its default by the others.

Fields

completion: ProviderCapabilities

What a completion provider composes.

max_documents: usize

The most documents one embedding or reranking request takes.

ndims: usize

The dimensionality of the returned vectors. Zero is unknown.

declared: Option<usize>

The embedding width the caller asked for, when they named one. None and zero disable the check that replies honour it.

Implementations

impl Capabilities

pub const fn completion(completion: ProviderCapabilities) -> Self

A completion provider’s capabilities.

pub const fn embedding(max_documents: usize, ndims: usize) -> Self

An embedding model’s batch limit and width, with no width declared.

pub const fn rerank(max_documents: usize) -> Self

A reranking model’s batch limit.

pub const fn declaring(self, declared: Option<usize>) -> Self

Record the width the caller named, when they named one.

Trait Implementations

impl Clone for Capabilities

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Capabilities

impl Debug for Capabilities

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Capabilities

fn default() -> Self

Returns the “default value” for a type.

impl Eq for Capabilities

impl PartialEq for Capabilities

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Capabilities