Struct FimCompletionRequest 

pub struct FimCompletionRequest {
    pub model: String,
    pub temperature: Option<Option<f64>>,
    pub top_p: Option<f64>,
    pub max_tokens: Option<Option<i32>>,
    pub stream: Option<bool>,
    pub stop: Option<Box<Stop>>,
    pub random_seed: Option<Option<i32>>,
    pub metadata: Option<Option<HashMap<String, Value>>>,
    pub prompt: String,
    pub suffix: Option<Option<String>>,
    pub min_tokens: Option<Option<i32>>,
}

Fields

model: String

ID of the model with FIM to use.

temperature: Option<Option<f64>>

top_p: Option<f64>

Nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. We generally recommend altering this or temperature but not both.

max_tokens: Option<Option<i32>>

stream: Option<bool>

Whether to stream back partial progress. If set, tokens will be sent as data-only server-side events as they become available, with the stream terminated by a data: [DONE] message. Otherwise, the server will hold the request open until the timeout or until completion, with the response containing the full result as JSON.

stop: Option<Box<Stop>>

random_seed: Option<Option<i32>>

metadata: Option<Option<HashMap<String, Value>>>

prompt: String

The text/code to complete.

suffix: Option<Option<String>>

min_tokens: Option<Option<i32>>

Implementations

impl FimCompletionRequest

pub fn new(model: String, prompt: String) -> FimCompletionRequest

Trait Implementations

impl Clone for FimCompletionRequest

fn clone(&self) -> FimCompletionRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FimCompletionRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for FimCompletionRequest

fn default() -> FimCompletionRequest

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for FimCompletionRequest

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for FimCompletionRequest

fn eq(&self, other: &FimCompletionRequest) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for FimCompletionRequest

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for FimCompletionRequest