Struct RequestKey 

pub struct RequestKey(pub u64);

A hashed request key (FNV-1a of serialized request content).

Two RequestKey values are equal iff the underlying hash values are equal. Collisions are theoretically possible but extremely rare for the prompt sizes typical in LLM serving.

Tuple Fields

0: u64

Implementations

impl RequestKey

pub fn from_str(s: &str) -> Self

Compute the key from a serialized request string.

Example

use oxibonsai_runtime::dedup::RequestKey;
let k1 = RequestKey::from_str("hello world");
let k2 = RequestKey::from_str("hello world");
assert_eq!(k1, k2);

pub fn from_messages(messages: &[(&str, &str)]) -> Self

Compute from a message list: FNV-1a over the concatenation of role + "\x00" + content + "\x01" for every message pair, in order.

The sentinel bytes (\x00 and \x01) prevent role/content boundary collisions (e.g. ("ab", "c") vs ("a", "bc")).

Example

use oxibonsai_runtime::dedup::RequestKey;
let msgs = [("user", "What is Rust?")];
let k = RequestKey::from_messages(&msgs);
assert_eq!(k, RequestKey::from_messages(&msgs));

pub fn value(&self) -> u64

Return the raw 64-bit hash value.

Trait Implementations

impl Clone for RequestKey

fn clone(&self) -> RequestKey

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RequestKey

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for RequestKey

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for RequestKey

fn eq(&self, other: &RequestKey) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for RequestKey

impl StructuralPartialEq for RequestKey