pub struct EmbeddingBatchStats {
pub batch_size: usize,
pub padded_seq_len: usize,
pub real_token_positions: u64,
}Expand description
Per-call batch statistics for measurement only (RFC-048 Task 011) —
never consulted by embedding logic itself. padded_seq_len is what
the backend’s padding strategy actually resolved to for this call;
real_token_positions is the sum, across the whole batch, of each
item’s non-padding token count (from its attention mask, where the
backend has one). batch_size * padded_seq_len is the padded
token-position count the call actually paid for.
Fields§
§batch_size: usize§padded_seq_len: usize§real_token_positions: u64Trait Implementations§
Source§impl Clone for EmbeddingBatchStats
impl Clone for EmbeddingBatchStats
impl Copy for EmbeddingBatchStats
Source§impl Debug for EmbeddingBatchStats
impl Debug for EmbeddingBatchStats
Source§impl Default for EmbeddingBatchStats
impl Default for EmbeddingBatchStats
impl Eq for EmbeddingBatchStats
Source§impl PartialEq for EmbeddingBatchStats
impl PartialEq for EmbeddingBatchStats
impl StructuralPartialEq for EmbeddingBatchStats
Auto Trait Implementations§
impl Freeze for EmbeddingBatchStats
impl RefUnwindSafe for EmbeddingBatchStats
impl Send for EmbeddingBatchStats
impl Sync for EmbeddingBatchStats
impl Unpin for EmbeddingBatchStats
impl UnsafeUnpin for EmbeddingBatchStats
impl UnwindSafe for EmbeddingBatchStats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more