pub struct KvSlotReport {
pub slot: u32,
pub tokens: u64,
pub bytes: Option<u64>,
pub ms: Option<f64>,
}Expand description
What llama.cpp reported for a slot action.
Fields§
§slot: u32§tokens: u64Tokens saved, restored or erased.
bytes: Option<u64>Bytes written or read (save and restore only).
ms: Option<f64>How long the server took (save and restore only).
Trait Implementations§
Source§impl Clone for KvSlotReport
impl Clone for KvSlotReport
Source§impl Debug for KvSlotReport
impl Debug for KvSlotReport
Source§impl PartialEq for KvSlotReport
impl PartialEq for KvSlotReport
Source§impl Serialize for KvSlotReport
impl Serialize for KvSlotReport
impl StructuralPartialEq for KvSlotReport
Auto Trait Implementations§
impl Forget for KvSlotReport
impl Freeze for KvSlotReport
impl RefUnwindSafe for KvSlotReport
impl Send for KvSlotReport
impl Sync for KvSlotReport
impl Unpin for KvSlotReport
impl UnsafeUnpin for KvSlotReport
impl UnwindSafe for KvSlotReport
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more