Struct LLM 

pub struct LLM {
    pub model: String,
    /* private fields */
}

A struct representing a Large Language Model (LLM)

Fields

model: String

The name or identifier of the model to use Examples: “gpt-4”, “gpt-3.5-turbo”, etc.

Implementations

impl LLM

pub fn from_model_name(model: &str) -> Result<Self>

pub fn openai_compatible_model( api_key: &str, base_url: &str, model: &str, ) -> Result<Self>

pub fn embeddings_model(&self, model: &str) -> EmbeddingsModel

pub fn client(&self) -> &Client

Trait Implementations

impl Completion for LLM

type Response = CompletionResponse

The type of response returned by the completion method.

async fn completion( &mut self, request: Request, ) -> Result<Self::Response, CompletionError>

Processes a Request and returns the generated response asynchronously.