Struct DaemonConfig 

pub struct DaemonConfig {

    pub claim_batch_size: usize,
    pub default_model_concurrency: usize,
    pub model_concurrency_limits: Arc<DashMap<String, usize>>,
    pub claim_interval_ms: u64,
    pub max_retries: Option<u32>,
    pub stop_before_deadline_ms: Option<i64>,
    pub backoff_ms: u64,
    pub backoff_factor: u64,
    pub max_backoff_ms: u64,
    pub timeout_ms: u64,
    pub status_log_interval_ms: Option<u64>,
    pub heartbeat_interval_ms: u64,
    pub should_retry: ShouldRetryFn,
    pub claim_timeout_ms: u64,
    pub processing_timeout_ms: u64,
    pub cancellation_poll_interval_ms: u64,
    pub sla_check_interval_seconds: u64,
    pub sla_thresholds: Vec<SlaThreshold>,
}

Configuration for the daemon.

Fields

claim_batch_size: usize

Maximum number of requests to claim in each iteration

default_model_concurrency: usize

Default concurrency limit per model

model_concurrency_limits: Arc<DashMap<String, usize>>

Per-model concurrency overrides (shared, can be updated dynamically)

claim_interval_ms: u64

How long to sleep between claim iterations

max_retries: Option<u32>

Maximum number of retry attempts before giving up.

stop_before_deadline_ms: Option<i64>

Stop retrying this many milliseconds before the batch expires. Positive values stop before the deadline (safety buffer). Negative values allow retrying after the deadline. If None, retries are not deadline-aware.

backoff_ms: u64

Base backoff duration in milliseconds (will be exponentially increased)

backoff_factor: u64

Factor by which the backoff_ms is increased with each retry

max_backoff_ms: u64

Maximum backoff time in milliseconds

timeout_ms: u64

Timeout for each individual request attempt in milliseconds

status_log_interval_ms: Option<u64>

Interval for logging daemon status (requests in flight) in milliseconds Set to None to disable periodic status logging

heartbeat_interval_ms: u64

Interval for sending heartbeats to update daemon status in database (milliseconds)

should_retry: ShouldRetryFn

Predicate function to determine if a response should be retried. Defaults to retrying 5xx, 429, and 408 status codes.

claim_timeout_ms: u64

Maximum time a request can stay in “claimed” state before being unclaimed and returned to pending (milliseconds). This handles daemon crashes.

processing_timeout_ms: u64

Maximum time a request can stay in “processing” state before being unclaimed and returned to pending (milliseconds). This handles daemon crashes during execution.

cancellation_poll_interval_ms: u64

Interval for polling database to check for cancelled batches (milliseconds) Determines how quickly in-flight requests are aborted when their batch is cancelled

sla_check_interval_seconds: u64

How often to check for batches approaching SLA deadlines (seconds) Default: 60 (1 minute) Only used if sla_thresholds is non-empty

sla_thresholds: Vec<SlaThreshold>

SLA threshold configurations. Each threshold defines a time limit and action to take when batches approach expiration. The daemon will query the database once per threshold to find at-risk batches.

Example: Two thresholds (warning at 1 hour, critical at 15 minutes)

use fusillade::daemon::{SlaThreshold, SlaAction, SlaLogLevel};

vec![
    SlaThreshold {
        name: "warning".to_string(),
        threshold_seconds: 3600,
        action: SlaAction::Log { level: SlaLogLevel::Warn },
    },
    SlaThreshold {
        name: "critical".to_string(),
        threshold_seconds: 900,
        action: SlaAction::Log { level: SlaLogLevel::Error },
    },
]

Trait Implementations

impl Clone for DaemonConfig

fn clone(&self) -> DaemonConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for DaemonConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for DaemonConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl From<&DaemonConfig> for RetryConfig

fn from(config: &DaemonConfig) -> Self

Converts to this type from the input type.

impl Serialize for DaemonConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.