Module modules

Module modules 

Source
Expand description

Library for AI Workbench file processing

This library provides modules for:

  • File discovery and S3 operations
  • Intelligent file splitting with type-aware chunking
  • Model runner for Bedrock integration
  • Job processor for orchestrating the entire workflow

Re-exports§

pub use file_discovery::FileDiscovery;
pub use file_discovery::FileInfo;
pub use file_splitter::FileSplitter;
pub use file_splitter::SplitConfig;
pub use file_splitter::FileType;
pub use model_runner::ModelRunner;
pub use job_processor::JobProcessor;
pub use job_processor::JobConfig;
pub use job_processor::FileChunkResult;
pub use job_processor::JobResult;
pub use job_processor::ProcessingMetadata;
pub use job_processor::FileProcessingInfo;
pub use job_processor::MarkdownBuilder;
pub use job_processor::MarkdownFormatter;

Modules§

file_discovery
file_splitter
File Splitter Library
job_processor
Job processor module for handling AI-powered file analysis workflows
model_runner