Module job_processor

Module job_processor 

Source
Expand description

Job processor module for handling AI-powered file analysis workflows

This module provides a complete pipeline for:

  • Discovering files in S3
  • Intelligent content-aware file splitting
  • AI model processing of file chunks
  • Result aggregation and markdown generation
  • Multi-format output (Markdown, JSON, metadata)

Re-exports§

pub use types::JobConfig;
pub use types::FileChunkResult;
pub use types::JobResult;
pub use types::ProcessingMetadata;
pub use types::FileProcessingInfo;
pub use markdown::MarkdownBuilder;
pub use markdown::MarkdownFormatter;
pub use core::JobProcessor;

Modules§

core
Core job processing logic
markdown
Markdown generation utilities for job processor output
types
Types and data structures for the job processor module