Struct DryRequest 

pub struct DryRequest {
    pub multiplier: f32,
    pub base: f32,
    pub allowed_length: i32,
    pub penalty_last_n: i32,
    pub sequence_breakers: Vec<String>,
}

DRY as a caller SPELLS it: four numbers and a list of strings, with the breakers not yet tokenised.

This is the shape a CLI flag set and an HTTP request body arrive in, and it exists so that both front ends resolve them the same way. Self::resolve is the only bridge to DryParams, and it is the one place that decides what happens when DRY is asked for and there is no vocabulary to tokenise the breakers against.

Fields

multiplier: f32

base: f32

allowed_length: i32

penalty_last_n: i32

sequence_breakers: Vec<String>

Implementations

impl DryRequest

pub fn is_enabled(&self) -> bool

The same three conditions DryParams::is_enabled reads, asked before the breakers have been tokenised – so the expensive vocabulary walk is skipped for the overwhelming majority of requests, which leave DRY off.

pub fn resolve( &self, vocab: Option<&dyn DryVocab>, total_context_size: usize, ) -> Result<DryParams, DryVocabMissing>

Tokenise the breakers and build the sampler’s parameters.

vocab is None when the loaded checkpoint has no real vocabulary. That is fine while DRY is off and a refusal when it is on; see DryVocabMissing.

An EMPTY breaker list needs no vocabulary either: it is the caller’s --dry-sequence-breaker none, and there is nothing to tokenise.

Trait Implementations

impl Clone for DryRequest

fn clone(&self) -> DryRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DryRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DryRequest

fn default() -> Self

llama.cpp’s defaults (common/common.h:242-245, 259), which are DISABLED: dry_multiplier is 0.

impl PartialEq for DryRequest

fn eq(&self, other: &DryRequest) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for DryRequest