pub struct EtaSampler {
pub epsilon: f32,
pub delta: f32,
}Expand description
Eta sampling — adaptively selects a probability cutoff based on distribution entropy.
The cutoff is max(epsilon, sqrt(exp(-H(p))) * delta) where H is the entropy.
Tokens below the cutoff are discarded.
Fields§
§epsilon: f32Minimum token probability (floor). Default: 0.0009.
delta: f32Entropy scaling factor for adaptive threshold. Default: 0.07.
Implementations§
Trait Implementations§
Source§impl Clone for EtaSampler
impl Clone for EtaSampler
Source§fn clone(&self) -> EtaSampler
fn clone(&self) -> EtaSampler
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for EtaSampler
impl RefUnwindSafe for EtaSampler
impl Send for EtaSampler
impl Sync for EtaSampler
impl Unpin for EtaSampler
impl UnsafeUnpin for EtaSampler
impl UnwindSafe for EtaSampler
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more