pub struct CompletionsRequest {
pub model: String,
pub prompt: CompletionPrompt,
pub max_tokens: Option<u32>,
pub temperature: Option<f32>,
pub top_p: Option<f32>,
pub n: Option<u32>,
pub stream: Option<bool>,
pub stop: Option<Vec<String>>,
pub logprobs: Option<u32>,
pub logit_bias: Option<HashMap<String, f32>>,
}Expand description
Legacy completions request
Fields§
§model: StringModel to use
prompt: CompletionPromptPrompt text. OpenAI’s legacy completions endpoint also accepts prompt
arrays, but Ferrum currently supports only a single string and rejects
other shapes with param=prompt.
max_tokens: Option<u32>Maximum tokens
temperature: Option<f32>Temperature
top_p: Option<f32>Top-p
n: Option<u32>Number of completions to generate. Ferrum currently supports only
n=1 and rejects larger values explicitly.
stream: Option<bool>Stream responses
stop: Option<Vec<String>>Stop sequences
logprobs: Option<u32>Legacy completions log probabilities. Explicitly rejected until implemented so clients don’t mistake a silent ignore for support.
logit_bias: Option<HashMap<String, f32>>Logit bias.
Trait Implementations§
Source§impl Clone for CompletionsRequest
impl Clone for CompletionsRequest
Source§fn clone(&self) -> CompletionsRequest
fn clone(&self) -> CompletionsRequest
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CompletionsRequest
impl Debug for CompletionsRequest
Source§impl<'de> Deserialize<'de> for CompletionsRequest
impl<'de> Deserialize<'de> for CompletionsRequest
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for CompletionsRequest
impl RefUnwindSafe for CompletionsRequest
impl Send for CompletionsRequest
impl Sync for CompletionsRequest
impl Unpin for CompletionsRequest
impl UnsafeUnpin for CompletionsRequest
impl UnwindSafe for CompletionsRequest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more