pub struct Capabilities {
pub completion: ProviderCapabilities,
pub max_documents: usize,
pub ndims: usize,
pub declared: Option<usize>,
}Expand description
What a runtime accounts for about a model. Each field matters to the operations that name it and is left at its default by the others.
Fields§
§completion: ProviderCapabilitiesWhat a completion provider composes.
max_documents: usizeThe most documents one embedding or reranking request takes.
ndims: usizeThe dimensionality of the returned vectors. Zero is unknown.
declared: Option<usize>The embedding width the caller asked for, when they named one. None
and zero disable the check that replies honour it.
Implementations§
Source§impl Capabilities
impl Capabilities
Sourcepub const fn completion(completion: ProviderCapabilities) -> Capabilities
pub const fn completion(completion: ProviderCapabilities) -> Capabilities
A completion provider’s capabilities.
Sourcepub const fn embedding(max_documents: usize, ndims: usize) -> Capabilities
pub const fn embedding(max_documents: usize, ndims: usize) -> Capabilities
An embedding model’s batch limit and width, with no width declared.
Sourcepub const fn rerank(max_documents: usize) -> Capabilities
pub const fn rerank(max_documents: usize) -> Capabilities
A reranking model’s batch limit.
Sourcepub const fn declaring(self, declared: Option<usize>) -> Capabilities
pub const fn declaring(self, declared: Option<usize>) -> Capabilities
Record the width the caller named, when they named one.
Trait Implementations§
Source§impl Clone for Capabilities
impl Clone for Capabilities
Source§fn clone(&self) -> Capabilities
fn clone(&self) -> Capabilities
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for Capabilities
Source§impl Debug for Capabilities
impl Debug for Capabilities
Source§impl Default for Capabilities
impl Default for Capabilities
Source§fn default() -> Capabilities
fn default() -> Capabilities
Returns the “default value” for a type. Read more
impl Eq for Capabilities
Source§impl PartialEq for Capabilities
impl PartialEq for Capabilities
impl StructuralPartialEq for Capabilities
Auto Trait Implementations§
impl Freeze for Capabilities
impl RefUnwindSafe for Capabilities
impl Send for Capabilities
impl Sync for Capabilities
impl Unpin for Capabilities
impl UnsafeUnpin for Capabilities
impl UnwindSafe for Capabilities
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.