Enum SyncEvent 

pub enum SyncEvent {
    ShardUpdated {
        rank: usize,
        layer: usize,
        seq_pos: usize,
    },
    PrefixConfirmed {
        prefix_id: u64,
        num_tokens: usize,
    },
    ShardEvicted {
        rank: usize,
        layer: usize,
        seq_pos: usize,
    },
    FlushAll,
}

Cache synchronisation events exchanged between ranks.

Variants

ShardUpdated

A shard has appended KV entries up to seq_pos.

Fields

rank: usize

layer: usize

seq_pos: usize

PrefixConfirmed

A prefix has been confirmed as shared across all ranks.

Fields

prefix_id: u64

Token hash or prefix ID.

num_tokens: usize

Number of tokens in the prefix.

ShardEvicted

A shard has evicted entries, invalidating positions beyond seq_pos.

Fields

rank: usize

layer: usize

seq_pos: usize

All positions > seq_pos are now invalid.

FlushAll

All shards should flush their caches (e.g., on model swap).

Trait Implementations

impl Clone for SyncEvent

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SyncEvent

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for SyncEvent

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for SyncEvent

impl PartialEq for SyncEvent

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for SyncEvent

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for SyncEvent