pub struct BoundSchema { /* private fields */ }Expand description
A schema bound to one vocabulary. Immutable; start as many independent Sessions from it
as there are concurrent generation sequences. Cheap to clone.
Implementations§
Source§impl BoundSchema
impl BoundSchema
Sourcepub fn mask_word_count(&self) -> usize
pub fn mask_word_count(&self) -> usize
The u32 word count a Session::write_mask buffer must have: ceil(vocab_size / 32).
Sourcepub fn mask_vocab_size(&self) -> usize
pub fn mask_vocab_size(&self) -> usize
This binding’s vocabulary width.
Sourcepub fn eos_token_id(&self) -> TokenId
pub fn eos_token_id(&self) -> TokenId
This binding’s EOS token id.
Sourcepub fn start_session(&self) -> Result<Session, SessionError>
pub fn start_session(&self) -> Result<Session, SessionError>
Starts one fresh, independently mutable generation sequence, Active at its initial
state.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for BoundSchema
impl RefUnwindSafe for BoundSchema
impl Send for BoundSchema
impl Sync for BoundSchema
impl Unpin for BoundSchema
impl UnsafeUnpin for BoundSchema
impl UnwindSafe for BoundSchema
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more