Skip to main content

RuntimePool

Struct RuntimePool 

Source
pub struct RuntimePool { /* private fields */ }
Expand description

A fixed pool of Runtimes over an MPMC channel.

A request checks a runtime out with get() and uses it exclusively; the returned RuntimeGuard sends it back on drop. When all runtimes are busy, get() waits fairly (FIFO) — the channel is the backpressure mechanism — and get_timeout() bounds that wait so an overloaded server sheds load instead of queueing without limit.

Implementations§

Source§

impl RuntimePool

Source

pub fn new(runtimes: Vec<Runtime>) -> Self

Creates a pool holding the given runtimes.

Source

pub fn with_rebuild<F>(runtimes: Vec<Runtime>, rebuild: F) -> Self
where F: Fn() -> Result<Runtime> + Send + Sync + 'static,

Creates a pool that recycles damaged states: when a request leaves a state poisoned (memory limit hit, panic), it is dropped and rebuild produces a fresh one so capacity is restored.

Source

pub fn with_companion<T: Any + Send + Sync>(self, companion: T) -> Self

Keeps companion with this pool, readable with companion().

Source

pub fn companion<T: Any + Send + Sync>(&self) -> Option<&T>

The companion set with with_companion(), when it is a T.

Source

pub fn size(&self) -> usize

Number of runtimes owned by the pool.

Source

pub fn available(&self) -> usize

Number of runtimes currently idle and available for checkout.

Source

pub async fn get(&self) -> RuntimeGuard

Checks a runtime out of the pool, waiting until one is available.

Source

pub async fn get_timeout(&self, wait: Duration) -> Option<RuntimeGuard>

Checks a runtime out, giving up after wait.

Returns None when no state became available in time, so the caller can shed the request (503) instead of letting it queue behind an overloaded pool. A zero duration disables the bound and waits like get().

Trait Implementations§

Source§

impl Clone for RuntimePool

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for RuntimePool

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> MaybeSend for T
where T: Send,

Source§

impl<T> MaybeSync for T
where T: Sync,

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more