pub enum KvSlotAction {
Save {
name: String,
},
Restore {
name: String,
},
Erase,
}Expand description
What to do with one llama.cpp request slot’s KV cache.
Variants§
Save
Write the slot’s KV cache to <name>.bin in the server’s slot directory.
Restore
Load <name>.bin into the slot.
Erase
Drop the slot’s KV cache, freeing it for other requests.
Trait Implementations§
Source§impl Clone for KvSlotAction
impl Clone for KvSlotAction
Source§impl Debug for KvSlotAction
impl Debug for KvSlotAction
impl Eq for KvSlotAction
Source§impl PartialEq for KvSlotAction
impl PartialEq for KvSlotAction
impl StructuralPartialEq for KvSlotAction
Auto Trait Implementations§
impl Forget for KvSlotAction
impl Freeze for KvSlotAction
impl RefUnwindSafe for KvSlotAction
impl Send for KvSlotAction
impl Sync for KvSlotAction
impl Unpin for KvSlotAction
impl UnsafeUnpin for KvSlotAction
impl UnwindSafe for KvSlotAction
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.