Struct ContextWindow 

pub struct ContextWindow {
    pub max_tokens: usize,
    pub output_reserve: usize,
}

Known model context window sizes

Fields

max_tokens: usize

Maximum context size in tokens

output_reserve: usize

Reserved tokens for output

Implementations

impl ContextWindow

pub const fn new(max_tokens: usize, output_reserve: usize) -> Self

Create a new context window configuration

pub const fn available_input(&self) -> usize

Available tokens for input after reserving output space

pub fn for_model(model: &str) -> Self

Get context window for known model

Trait Implementations

impl Clone for ContextWindow

fn clone(&self) -> ContextWindow

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ContextWindow

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ContextWindow

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ContextWindow

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ContextWindow

fn eq(&self, other: &ContextWindow) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ContextWindow

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for ContextWindow

impl Eq for ContextWindow

impl StructuralPartialEq for ContextWindow