coglet 0.21.0

High-performance prediction server for Cog ML models
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

//! Permit pool for concurrent slot management.
//!
//! The permit system uses typestate to enforce valid state transitions at compile time:
//! - `PermitInUse` → `PermitIdle` via `into_idle()` (returns to pool on drop)
//! - `PermitInUse` → `PermitPoisoned` via `into_poisoned()` (orphaned on drop)
//! - `PermitPoisoned` → `PermitIdle`: NOT POSSIBLE (no method exists)
//!
//! Slot poisoning is a pool-level property (`PermitPool::poison()`). A poisoned slot
//! is permanently removed from the pool regardless of whether a prediction was active.
//! `PermitIdle::drop` checks the pool-level poison flag and skips returning the permit.

mod pool;
mod slot;

pub use pool::{
    AnyPermit, InactiveSlotIdleToken, PermitError, PermitIdle, PermitInUse, PermitPoisoned,
    PermitPool, SlotIdleToken,
};
pub use slot::{PredictionSlot, UnregisteredPredictionSlot};