pub struct RecurrentStateManagerStats {
pub total_memory_bytes: usize,
pub used_memory_bytes: usize,
pub active_states: usize,
pub active_state_tensors: usize,
pub total_batch_slots: usize,
pub used_batch_slots: usize,
pub allocation_count: u64,
pub allocation_failures: u64,
pub eviction_count: u64,
}Expand description
Aggregate recurrent-state manager statistics.
Fields§
§total_memory_bytes: usizeTotal memory budget visible to this manager.
used_memory_bytes: usizeMemory currently used by active recurrent states.
active_states: usizeNumber of active state handles.
active_state_tensors: usizeNumber of active state tensors.
total_batch_slots: usizeTotal slots visible to this manager.
used_batch_slots: usizeSlots currently allocated to active state handles.
allocation_count: u64Number of successful allocations.
allocation_failures: u64Number of failed allocations.
eviction_count: u64Number of evictions performed.
Trait Implementations§
Source§impl Clone for RecurrentStateManagerStats
impl Clone for RecurrentStateManagerStats
Source§fn clone(&self) -> RecurrentStateManagerStats
fn clone(&self) -> RecurrentStateManagerStats
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RecurrentStateManagerStats
impl Debug for RecurrentStateManagerStats
Source§impl<'de> Deserialize<'de> for RecurrentStateManagerStats
impl<'de> Deserialize<'de> for RecurrentStateManagerStats
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for RecurrentStateManagerStats
impl RefUnwindSafe for RecurrentStateManagerStats
impl Send for RecurrentStateManagerStats
impl Sync for RecurrentStateManagerStats
impl Unpin for RecurrentStateManagerStats
impl UnsafeUnpin for RecurrentStateManagerStats
impl UnwindSafe for RecurrentStateManagerStats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more