Enum TrtllmCapacityPolicy 

pub enum TrtllmCapacityPolicy {
    GuaranteedNoEvict,
}

TensorRT-LLM capacity scheduler policy.

The mocker currently models the TensorRT-LLM default only. Keeping the policy explicit prevents a config from silently falling back to vLLM admission or preemption semantics.

Variants

GuaranteedNoEvict

Reserve each admitted request through completion and never evict it.

Trait Implementations

impl Clone for TrtllmCapacityPolicy

fn clone(&self) -> TrtllmCapacityPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TrtllmCapacityPolicy

impl Debug for TrtllmCapacityPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TrtllmCapacityPolicy

fn default() -> TrtllmCapacityPolicy

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for TrtllmCapacityPolicy

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for TrtllmCapacityPolicy

impl PartialEq for TrtllmCapacityPolicy

fn eq(&self, other: &TrtllmCapacityPolicy) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for TrtllmCapacityPolicy

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for TrtllmCapacityPolicy