pub struct ModelGenerationPoolHealthSnapshot {
pub pool: ModelGenerationPool,
pub local_max_concurrency: usize,
pub local_reserved: usize,
pub local_available: usize,
pub scheduler: Option<TaskSchedulerQuotaHealthSnapshot>,
}Expand description
Read-only, secret-free configuration and occupancy evidence for one model generation pool.
local_reserved includes permits waiting for the shared scheduler after
acquiring the local client gate; it is therefore intentionally distinct
from provider calls that have reached the transport. The optional scheduler
projection carries the same pool identity and retains a bounded recent
health epoch after the final reservation is released.
Fields§
§pool: ModelGenerationPoolImmutable provider/model capacity descriptor.
local_max_concurrency: usizeEffective local gate limit for this admission facade.
local_reserved: usizeLocal permits currently reserved by this facade.
local_available: usizeLocal permits immediately available to this facade.
scheduler: Option<TaskSchedulerQuotaHealthSnapshot>Shared scheduler health for this pool, when the facade is scheduler-bound.
Trait Implementations§
Source§impl Clone for ModelGenerationPoolHealthSnapshot
impl Clone for ModelGenerationPoolHealthSnapshot
Source§fn clone(&self) -> ModelGenerationPoolHealthSnapshot
fn clone(&self) -> ModelGenerationPoolHealthSnapshot
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl<'de> Deserialize<'de> for ModelGenerationPoolHealthSnapshot
impl<'de> Deserialize<'de> for ModelGenerationPoolHealthSnapshot
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for ModelGenerationPoolHealthSnapshot
impl StructuralPartialEq for ModelGenerationPoolHealthSnapshot
Auto Trait Implementations§
impl Freeze for ModelGenerationPoolHealthSnapshot
impl RefUnwindSafe for ModelGenerationPoolHealthSnapshot
impl Send for ModelGenerationPoolHealthSnapshot
impl Sync for ModelGenerationPoolHealthSnapshot
impl Unpin for ModelGenerationPoolHealthSnapshot
impl UnsafeUnpin for ModelGenerationPoolHealthSnapshot
impl UnwindSafe for ModelGenerationPoolHealthSnapshot
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
fn with_context(self, otel_cx: Context) -> WithContext<Self> ⓘ
Source§fn with_current_context(self) -> WithContext<Self> ⓘ
fn with_current_context(self) -> WithContext<Self> ⓘ
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more