pub struct ContextWindowCompressionConfig {
pub sliding_window: Option<SlidingWindow>,
pub trigger_tokens: Option<u64>,
}Expand description
Server-side context compression. When the context grows past
trigger_tokens, the server compresses it down to
sliding_window.target_tokens.
This is not a presence-activated empty object. The Live API expects a
compression mechanism to be selected, so callers should normally send at
least sliding_window: Some(SlidingWindow::default()), which serializes as
{"slidingWindow": {}}.
Fields§
§sliding_window: Option<SlidingWindow>§trigger_tokens: Option<u64>Token count that triggers compression (default ≈ 80% of context limit).
Trait Implementations§
Source§impl Clone for ContextWindowCompressionConfig
impl Clone for ContextWindowCompressionConfig
Source§fn clone(&self) -> ContextWindowCompressionConfig
fn clone(&self) -> ContextWindowCompressionConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Default for ContextWindowCompressionConfig
impl Default for ContextWindowCompressionConfig
Source§fn default() -> ContextWindowCompressionConfig
fn default() -> ContextWindowCompressionConfig
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for ContextWindowCompressionConfig
impl<'de> Deserialize<'de> for ContextWindowCompressionConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for ContextWindowCompressionConfig
impl PartialEq for ContextWindowCompressionConfig
Source§fn eq(&self, other: &ContextWindowCompressionConfig) -> bool
fn eq(&self, other: &ContextWindowCompressionConfig) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for ContextWindowCompressionConfig
Auto Trait Implementations§
impl Freeze for ContextWindowCompressionConfig
impl RefUnwindSafe for ContextWindowCompressionConfig
impl Send for ContextWindowCompressionConfig
impl Sync for ContextWindowCompressionConfig
impl Unpin for ContextWindowCompressionConfig
impl UnsafeUnpin for ContextWindowCompressionConfig
impl UnwindSafe for ContextWindowCompressionConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more