Struct LlamaLogitBias

pub struct LlamaLogitBias { /* private fields */ }

A transparent wrapper around llama_logit_bias.

Represents a bias to be applied to a specific token during text generation. The bias modifies the likelihood of the token being selected.

Do not rely on repr(transparent) for this type. It should be considered an implementation detail and may change across minor versions.

Implementations

impl LlamaLogitBias

pub fn new(LlamaToken: LlamaToken, bias: f32) -> Self

Creates a new logit bias for a specific token with the given bias value.

Examples

let token = LlamaToken::new(1);
let bias = LlamaLogitBias::new(token, 1.5);

pub fn token(&self) -> LlamaToken

Gets the token this bias applies to.

Examples

let token = LlamaToken::new(1);
let bias = LlamaLogitBias::new(token, 1.5);
assert_eq!(bias.token(), token);

pub fn bias(&self) -> f32

Gets the bias value.

Examples

let token = LlamaToken::new(1);
let bias = LlamaLogitBias::new(token, 1.5);
assert_eq!(bias.bias(), 1.5);

pub fn set_token(&mut self, token: LlamaToken)

Sets the token this bias applies to.

Examples

let token = LlamaToken::new(1);
let mut bias = LlamaLogitBias::new(token, 1.5);
let new_token = LlamaToken::new(2);
bias.set_token(new_token);
assert_eq!(bias.token(), new_token);

pub fn set_bias(&mut self, bias: f32)

Sets the bias value.

Examples

let token = LlamaToken::new(1);
let mut bias = LlamaLogitBias::new(token, 1.5);
bias.set_bias(2.0);
assert_eq!(bias.bias(), 2.0);

Trait Implementations

impl Clone for LlamaLogitBias

fn clone(&self) -> LlamaLogitBias

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaLogitBias

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for LlamaLogitBias

fn eq(&self, other: &LlamaLogitBias) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for LlamaLogitBias

impl StructuralPartialEq for LlamaLogitBias