Type Alias CreateModelResponseProperties

Source
pub type CreateModelResponseProperties = ModelResponseProperties;

Aliased Type§

pub struct CreateModelResponseProperties {
    pub metadata: Option<HashMap<String, String>>,
    pub temperature: Option<f64>,
    pub top_p: Option<f64>,
    pub user: Option<String>,
    pub service_tier: Option<ServiceTier>,
}

Fields§

§metadata: Option<HashMap<String, String>>§temperature: Option<f64>

What sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. We generally recommend altering this or top_p but not both.

§top_p: Option<f64>

An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered.

We generally recommend altering this or temperature but not both.

§user: Option<String>

A stable identifier for your end-users. Used to boost cache hit rates by better bucketing similar requests and to help OpenAI detect and prevent abuse. Learn more.

§service_tier: Option<ServiceTier>