Crate orbok_workers 

orbok-workers

Synchronous pipeline workers for M5/M6: pull queued jobs from the catalog and execute them in dependency order.

Worker chain (per file):

[Scan queues Extract]
  → ExtractionWorker  (extract + cache + record)
  → ChunkAndIndexWorker (chunk + FTS index + chunk_locations)

Failure isolation: one file’s failure never stops the whole run (RFC-004 §16, RFC-005 §13). Workers update the relevant catalog records with the error category.

Re-exports

pub use storage::update_storage_accounting;

Modules

storage

Storage accounting (RFC-011 §9): measures actual orbok storage consumption and updates the storage_accounting table.

Structs

ChunkAndIndexWorker

Chunk-and-index worker.

EmbeddingWorker

Embedding worker for one file.

ExtractionWorker

Extraction worker instance, held for the duration of an index run.

Functions

run_pending

Run all queued jobs until the queue is empty or limit jobs have been processed. Returns the number of jobs that succeeded.