Module recurrent_state 

Recurrent-state cache contracts for state-space / hybrid models.

Recurrent state is intentionally separate from KV cache. KV grows with sequence length and is addressed through attention blocks; recurrent state is compact per-layer state that can coexist with KV in hybrid models.

Structs

RecurrentStateHandleStats

Statistics for one recurrent-state handle.

RecurrentStateManagerStats

Aggregate recurrent-state manager statistics.

RecurrentStateSpec

Allocation request for recurrent state.

RecurrentStateTensorSpec

A single recurrent-state tensor owned by a model layer.

Enums

RecurrentStateResumePolicy

Resume policy for state that has been preempted or evicted.

Traits

RecurrentStateHandle

Recurrent-state cache handle.

RecurrentStateManager

Recurrent-state cache manager for allocation and lifecycle management.