pub struct TransformContext<'a> { /* private fields */ }Expand description
Borrowed state supplied to one Rust logit-transform invocation.
Implementations§
Source§impl<'a> TransformContext<'a>
impl<'a> TransformContext<'a>
Sourcepub fn new(
step: u32,
causal_tokens: &'a [TokenId],
candidate_tokens: &'a [TokenId],
logits: &'a mut [f32],
) -> Result<TransformContext<'a>, PipelineError>
pub fn new( step: u32, causal_tokens: &'a [TokenId], candidate_tokens: &'a [TokenId], logits: &'a mut [f32], ) -> Result<TransformContext<'a>, PipelineError>
Creates a validated borrowed candidate view.
§Errors
Returns an error when token and logit lengths disagree.
Sourcepub const fn causal_tokens(&self) -> &[TokenId]
pub const fn causal_tokens(&self) -> &[TokenId]
Exact prompt and previously admitted generation tokens.
Sourcepub const fn candidate_tokens(&self) -> &[TokenId]
pub const fn candidate_tokens(&self) -> &[TokenId]
Immutable candidate token identifiers.
Sourcepub fn logits_mut(&mut self) -> &mut [f32]
pub fn logits_mut(&mut self) -> &mut [f32]
Mutable candidate logits corresponding one-for-one with token IDs.
Sourcepub fn candidates_mut(&mut self) -> impl Iterator<Item = (TokenId, &mut f32)>
pub fn candidates_mut(&mut self) -> impl Iterator<Item = (TokenId, &mut f32)>
Iterates token/logit pairs without permitting token-ID mutation.
Auto Trait Implementations§
impl<'a> !UnwindSafe for TransformContext<'a>
impl<'a> Freeze for TransformContext<'a>
impl<'a> RefUnwindSafe for TransformContext<'a>
impl<'a> Send for TransformContext<'a>
impl<'a> Sync for TransformContext<'a>
impl<'a> Unpin for TransformContext<'a>
impl<'a> UnsafeUnpin for TransformContext<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more