pub struct TokenBudgetSampler { /* private fields */ }Expand description
Checkpointable variable-size batches over measured sequence lengths. Distributed ranks receive equal sample counts, but can receive different batch counts; synchronized training must account for uneven batch counts.
Implementations§
Source§impl TokenBudgetSampler
impl TokenBudgetSampler
Sourcepub fn new(
lengths: Vec<usize>,
config: TokenBudgetConfig,
limits: ResourceLimits,
) -> Result<Self>
pub fn new( lengths: Vec<usize>, config: TokenBudgetConfig, limits: ResourceLimits, ) -> Result<Self>
Validates positive budgets and every measured length before batching.
Trait Implementations§
Source§impl BatchSource for TokenBudgetSampler
impl BatchSource for TokenBudgetSampler
Auto Trait Implementations§
impl Forget for TokenBudgetSampler
impl Freeze for TokenBudgetSampler
impl RefUnwindSafe for TokenBudgetSampler
impl Send for TokenBudgetSampler
impl Sync for TokenBudgetSampler
impl Unpin for TokenBudgetSampler
impl UnsafeUnpin for TokenBudgetSampler
impl UnwindSafe for TokenBudgetSampler
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more