Skip to main content

Crate anyllm_batch_engine

Crate anyllm_batch_engine 

Source
Expand description

Batch orchestration engine: job queue, file storage, webhook delivery.

HTTP-agnostic. The proxy crate wires this into axum routes.

Re-exports§

pub use engine::BatchEngine;
pub use error::EngineError;
pub use error::QueueError;
pub use validation::validate_jsonl;
pub use validation::ValidatedJsonl;
pub use job::*;

Modules§

db
Database access layer for batch jobs and webhook tasks. SQLite schema initialization for batch_engine tables.
engine
The core orchestrator orchestrating background job processing loops. BatchEngine: the main entry point for batch operations. Thin facade over JobQueue, FileStore, and WebhookQueue.
error
Engine and queue error definitions. Engine and queue error types.
file_store
Local file storage handling JSONL batch request and response payloads. Batch file storage (upload, metadata, content retrieval).
job
Batch job structs, states, and metadata types. Core batch orchestration types. HTTP-agnostic.
queue
FIFO/Priority job queues (SQLite or in-memory). JobQueue trait and implementations.
validation
Request validation helpers for batch JSONL lines. JSONL batch file validation.
webhook
Outbound webhook notification queues and delivery workers. Durable webhook delivery queue and dispatcher.