Struct ModelDescription

pub struct ModelDescription {
    pub backend: String,
    pub provider: String,
    pub model_name: String,
    pub endpoint: Option<Url>,
}

A parsed model id data structure.

Fields

backend: String

Name of the backend to invoke for generation. i.e. outsource

provider: String

Name of the provider of the model. i.e. openai-chat

model_name: String

Name of the model. i.e. gpt-3.5-turbo

endpoint: Option<Url>

Custom endpoint (if any)

Implementations

impl ModelDescription

pub fn is_chat_model(&self) -> bool

Checks if the model is a “chat” model. Currently, it checks if the provider name ends with -chat.

Trait Implementations

impl Display for ModelDescription

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl FromStr for ModelDescription

type Err = ()

The associated error which can be returned from parsing.

fn from_str(s: &str) -> Result<Self, Self::Err>

Parses a string s to return a value of this type.