Struct ModelEntry 

#[non_exhaustive]
pub struct ModelEntry {
    pub model: String,
    pub max_questions: u64,
    pub max_items: u64,
    pub context_tokens: Option<u64>,
    pub images: Option<ImageSupport>,
    pub price: Option<Price>,
    pub egress_host: String,
}

One served model.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

model: String

The catalog id, <provider>/<model>.

max_questions: u64

Most questions in one batch: the tighter of the catalog’s and the module’s limits.

max_items: u64

Most items in one batch: the tighter of the catalog’s and the module’s limits, so never above limits.max_items.

context_tokens: Option<u64>

The model’s context, in tokens, from the catalog. The provider truncates state beyond it without saying so. Absent when the catalog states no exact figure (a provider that says only “64k” gets no guessed number); absent is not zero.

images: Option<ImageSupport>

The model’s image support; null when it takes no images. Always encoded, never omitted, so “no images” is stated rather than implied.

price: Option<Price>

The catalog price; absent when the model is unpriced.

egress_host: String

The provider host item text is sent to, e.g. api.typesafe.ai.

Implementations

impl ModelEntry

pub fn new( model: impl Into<String>, max_questions: u64, max_items: u64, context_tokens: impl Into<Option<u64>>, egress_host: impl Into<String>, ) -> Self

context_tokens takes a number, or None when the catalog states no exact figure.

pub fn with_images(self, images: ImageSupport) -> Self

pub fn with_price(self, price: Price) -> Self

pub fn is_priced(&self) -> bool

Whether the model has a price for at least one token direction.

Trait Implementations

impl Clone for ModelEntry

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelEntry

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ModelEntry

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ModelEntry

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ModelEntry

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ModelEntry