pub enum CompactionReason {
OutputLength,
ContextThreshold(u32),
}Expand description
Why compaction is needed after a turn.
Variants§
OutputLength
The model hit max output length without explicit max_tokens.
ContextThreshold(u32)
Prompt tokens exceeded 90% of the context window.
Trait Implementations§
Source§impl Clone for CompactionReason
impl Clone for CompactionReason
impl Copy for CompactionReason
Source§impl Debug for CompactionReason
impl Debug for CompactionReason
Source§impl<'de> Deserialize<'de> for CompactionReason
impl<'de> Deserialize<'de> for CompactionReason
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Forget for CompactionReason
impl Freeze for CompactionReason
impl Move for CompactionReason
impl RefUnwindSafe for CompactionReason
impl Send for CompactionReason
impl Sync for CompactionReason
impl Unpin for CompactionReason
impl UnsafeUnpin for CompactionReason
impl UnwindSafe for CompactionReason
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more