pub struct CheckpointGenerationConfig {
pub do_sample: Option<bool>,
pub temperature: Option<f32>,
pub top_k: Option<i32>,
pub top_p: Option<f32>,
pub min_p: Option<f32>,
pub repetition_penalty: Option<f32>,
pub repeat_last_n: Option<i32>,
pub frequency_penalty: Option<f32>,
pub presence_penalty: Option<f32>,
pub max_new_tokens: Option<usize>,
}Expand description
Sampling values declared by a checkpoint generation configuration.
Fields§
§do_sample: Option<bool>Whether stochastic sampling is recommended.
temperature: Option<f32>Recommended temperature.
top_k: Option<i32>Recommended top-k cutoff.
top_p: Option<f32>Recommended nucleus probability.
min_p: Option<f32>Recommended minimum-probability filter.
repetition_penalty: Option<f32>Recommended multiplicative repetition penalty.
repeat_last_n: Option<i32>Recommended generated-history window for repetition penalties.
frequency_penalty: Option<f32>Recommended additive frequency penalty.
presence_penalty: Option<f32>Recommended additive presence penalty.
max_new_tokens: Option<usize>Recommended maximum number of new tokens.
Trait Implementations§
Source§impl Clone for CheckpointGenerationConfig
impl Clone for CheckpointGenerationConfig
Source§fn clone(&self) -> CheckpointGenerationConfig
fn clone(&self) -> CheckpointGenerationConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CheckpointGenerationConfig
impl Debug for CheckpointGenerationConfig
Source§impl Default for CheckpointGenerationConfig
impl Default for CheckpointGenerationConfig
Source§fn default() -> CheckpointGenerationConfig
fn default() -> CheckpointGenerationConfig
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for CheckpointGenerationConfig
impl<'de> Deserialize<'de> for CheckpointGenerationConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for CheckpointGenerationConfig
Auto Trait Implementations§
impl Freeze for CheckpointGenerationConfig
impl RefUnwindSafe for CheckpointGenerationConfig
impl Send for CheckpointGenerationConfig
impl Sync for CheckpointGenerationConfig
impl Unpin for CheckpointGenerationConfig
impl UnsafeUnpin for CheckpointGenerationConfig
impl UnwindSafe for CheckpointGenerationConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more