Function run_pending 

pub fn run_pending(
    catalog: &Catalog,
    extract_worker: &ExtractionWorker<'_>,
    chunk_worker: &ChunkAndIndexWorker<'_>,
    embed_worker: Option<&EmbeddingWorker<'_>>,
    limit: u32,
) -> OrbokResult<u64>

Run all queued jobs until the queue is empty or limit jobs have been processed. Returns the number of jobs that succeeded.