Enum PreemptionMode 

pub enum PreemptionMode {
    Lifo,
    Fifo,
}

Preemption policy for evicting decode requests under memory pressure

Variants

Lifo

Evict the newest request (matches vLLM v1 default)

Fifo

Evict the oldest request

Trait Implementations

impl Clone for PreemptionMode

fn clone(&self) -> PreemptionMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for PreemptionMode

impl Debug for PreemptionMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PreemptionMode

fn default() -> PreemptionMode

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for PreemptionMode

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for PreemptionMode

impl FromStr for PreemptionMode

type Err = String

The associated error which can be returned from parsing.

fn from_str(value: &str) -> Result<Self, Self::Err>

Parses a string s to return a value of this type.

impl PartialEq for PreemptionMode

fn eq(&self, other: &PreemptionMode) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for PreemptionMode

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for PreemptionMode