Struct ModelConfiguration

pub struct ModelConfiguration {
    pub engine: ChatGPTEngine,
    pub temperature: f32,
    pub top_p: f32,
    pub max_tokens: Option<u32>,
    pub presence_penalty: f32,
    pub frequency_penalty: f32,
    pub reply_count: u32,
    pub api_url: Url,
    pub timeout: Duration,
    pub function_validation: FunctionValidationStrategy,
}

The struct containing main configuration for the ChatGPT API

Fields

engine: ChatGPTEngine

The GPT version used.

temperature: f32

Controls randomness of the output. Higher values means more random

top_p: f32

Controls diversity via nucleus sampling, not recommended to use with temperature

max_tokens: Option<u32>

Controls the maximum number of tokens to generate in the completion

presence_penalty: f32

Determines how much to penalize new tokens passed on their existing presence so far

frequency_penalty: f32

Determines how much to penalize new tokens based on their existing frequency so far

reply_count: u32

The maximum amount of replies

api_url: Url

URL of the /v1/chat/completions endpoint. Can be used to set a proxy

timeout: Duration

Timeout for the http requests sent to avoid potentially permanently hanging requests.

function_validation: FunctionValidationStrategy

Strategy for function validation strategy. Whenever ChatGPT fails to call a function correctly, this strategy is applied.

Trait Implementations

impl Clone for ModelConfiguration

fn clone(&self) -> ModelConfiguration

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelConfiguration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModelConfiguration

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for ModelConfiguration

fn eq(&self, other: &ModelConfiguration) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for ModelConfiguration

fn partial_cmp(&self, other: &ModelConfiguration) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl StructuralPartialEq for ModelConfiguration