Enum SchedulerPolicy 

pub enum SchedulerPolicy {
    Fcfs,
    Priority,
    LongestPrefixMatch,
}

Native scheduler admission order.

Raw and serde chat request JSON can carry a priority field that the native OpenAI-compatible path parses and submits. Direct completion, completion streaming, and crate::Request submissions currently default to priority zero and tie by arrival; caller-selected priorities for those direct APIs require a future C ABI/API change.

Variants

Fcfs

Process requests in arrival order.

Priority

Order requests by priority and then arrival time.

This variant selects the native priority queue; it does not itself assign a priority to a request.

LongestPrefixMatch

Prefer requests sharing the longest cached prefix.

Trait Implementations

impl Clone for SchedulerPolicy

fn clone(&self) -> SchedulerPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SchedulerPolicy

impl Debug for SchedulerPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SchedulerPolicy

fn default() -> SchedulerPolicy

Returns the “default value” for a type.

impl Eq for SchedulerPolicy

impl PartialEq for SchedulerPolicy

fn eq(&self, other: &SchedulerPolicy) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SchedulerPolicy