pub struct ModelInferenceConfig {
pub max_new_tokens: usize,
pub pad_token_id: u32,
}Expand description
Greedy generation options.
Fields§
§max_new_tokens: usize§pad_token_id: u32Trait Implementations§
Source§impl Clone for ModelInferenceConfig
impl Clone for ModelInferenceConfig
Source§fn clone(&self) -> ModelInferenceConfig
fn clone(&self) -> ModelInferenceConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelInferenceConfig
impl Debug for ModelInferenceConfig
Auto Trait Implementations§
impl Freeze for ModelInferenceConfig
impl RefUnwindSafe for ModelInferenceConfig
impl Send for ModelInferenceConfig
impl Sync for ModelInferenceConfig
impl Unpin for ModelInferenceConfig
impl UnsafeUnpin for ModelInferenceConfig
impl UnwindSafe for ModelInferenceConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more