Skip to main content

Module queue

Module queue 

Source
Expand description

Per-session command queue with lane-based priority scheduling

Provides session-isolated command queues where each session has its own set of lanes with configurable concurrency limits and priorities.

§External Task Handling

Supports pluggable task handlers allowing SDK users to implement custom processing logic for different lanes:

  • Internal: Default, tasks executed within the runtime
  • External: Tasks sent to SDK, wait for callback completion
  • Hybrid: Internal execution with external notification

§Implementation

The actual queue implementation is in SessionLaneQueue which is backed by a3s-lane with features like DLQ, metrics, retry policies, and rate limiting.

Structs§

ExternalTask
An external task that needs to be processed by SDK
ExternalTaskResult
Result of external task processing
LaneHandlerConfig
Configuration for a lane’s task handler
LaneStatus
Status of a single lane
PriorityBoostConfig
Priority boost configuration
RateLimitConfig
Rate limit configuration
RetryPolicyConfig
Retry policy configuration
SessionQueueConfig
Configuration for a session command queue
SessionQueueStats
Statistics for a session queue

Enums§

SessionLane
Session lane for queue priority scheduling and HITL auto-approval
TaskHandlerMode
Task handler mode determines how tasks in a lane are processed

Traits§

SessionCommand
Command to be executed in a session queue