Struct Config 

pub struct Config {

    pub provider: ModelProvider,
    pub name: String,
    pub api_key: String,
    pub api_url: String,
    pub api_version: Option<String>,
    pub max_tokens: Option<i64>,
    pub n: Option<i64>,
    pub temperature: Option<f64>,
    pub top_p: Option<f64>,
    pub top_k: Option<i64>,
    pub frequency_penalty: Option<f64>,
    pub presence_penalty: Option<f64>,
    pub stop_sequence: Option<String>,
}

Model parameters.

Fields

provider: ModelProvider

Model name.

name: String

Model name.

api_key: String

API key.

api_url: String

Model API URL.

api_version: Option<String>

Model API version.

max_tokens: Option<i64>

Maximum number of tokens that will be generated.

n: Option<i64>

Number of variants to generate.

temperature: Option<f64>

Level of randomization when choosing tokens.

top_p: Option<f64>

Only the tokens comprising the top_p probability mass will be considered.

top_k: Option<i64>

Only k tokens with the most probability will be considered.

frequency_penalty: Option<f64>

Penalize new tokens based on their existing frequency.

presence_penalty: Option<f64>

Penalize new tokens based on whether they appear in the text so far.

stop_sequence: Option<String>

Sequences at which model will stop generating.

Implementations

impl Config

pub fn new( provider: ModelProvider, name: String, api_key: String, api_url: String, ) -> Self

Create minimal config using provider, model name, API key, and API URL.

Trait Implementations

impl Clone for Config

fn clone(&self) -> Config

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Config

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.