Struct PromptBudgetConfig 

pub struct PromptBudgetConfig {
    pub prompt_overhead_tokens: u32,
    pub output_reserve_tokens: u32,
    pub safety_margin_tokens: u32,
}

Host-counted provider request overhead and reserves deducted before context rendering. These values are input facts, so configuring them through the kernel journal makes replay use the same hard prompt allowance as the original run.

Fields

prompt_overhead_tokens: u32

output_reserve_tokens: u32

safety_margin_tokens: u32

Implementations

impl PromptBudgetConfig

pub fn reserved_tokens(self) -> u32

Trait Implementations

impl Clone for PromptBudgetConfig

fn clone(&self) -> PromptBudgetConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for PromptBudgetConfig

impl Debug for PromptBudgetConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PromptBudgetConfig

fn default() -> PromptBudgetConfig

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for PromptBudgetConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for PromptBudgetConfig

impl PartialEq for PromptBudgetConfig

fn eq(&self, other: &PromptBudgetConfig) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for PromptBudgetConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for PromptBudgetConfig