Enum SchedulerCommand 

pub enum SchedulerCommand {
    Submit(DirectRequest),
    CancelRequest {
        request_id: Uuid,
    },
    SubmitHandoffPrefill {
        handoff_id: HandoffId,
        request: DirectRequest,
    },
    ReleaseSource {
        handoff_id: HandoffId,
    },
    CancelSource {
        handoff_id: HandoffId,
    },
    ReserveDestination {
        handoff_id: HandoffId,
        request: DirectRequest,
    },
    ActivateDestination {
        handoff_id: HandoffId,
    },
    CancelDestination {
        handoff_id: HandoffId,
    },
}

Variants

Submit(DirectRequest)

CancelRequest

Remove an ordinary request from the live scheduler by its stable ID.

Live requests use a dedicated cancellation lane. Their owned submit task must acknowledge admission before cancellation is enqueued, so a dropped network stream cannot race ahead of its own request admission.

Fields

request_id: Uuid

SubmitHandoffPrefill

Fields

handoff_id: HandoffId

request: DirectRequest

ReleaseSource

Fields

handoff_id: HandoffId

CancelSource

Fields

handoff_id: HandoffId

ReserveDestination

Fields

handoff_id: HandoffId

request: DirectRequest

ActivateDestination

Fields

handoff_id: HandoffId

CancelDestination

Fields

handoff_id: HandoffId