Struct SchedulerConfig 

pub struct SchedulerConfig {
    pub batch_size: usize,
    pub max_wait: Duration,
    pub poll_interval: Duration,
    pub context_length_bucket: u32,
}

Configuration for the pipeline scheduler.

Fields

batch_size: usize

Maximum number of work items per batch submission.

max_wait: Duration

Maximum time a work item can wait before being force-scheduled.

poll_interval: Duration

Poll interval when waiting for batch results.

context_length_bucket: u32

Context length bucket size for Ollama grouping (in tokens). Items within the same bucket are considered similar enough.

Trait Implementations

impl Clone for SchedulerConfig

fn clone(&self) -> SchedulerConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SchedulerConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SchedulerConfig

fn default() -> Self

Returns the “default value” for a type.