Module pipeline

Module pipeline 

Source
Expand description

文本处理管道模块

提供文本收集、过滤和批次管理功能

Re-exports§

pub use collector::TextCollector;
pub use collector::TextItem;
pub use collector::TextType;
pub use filter::TextFilter;
pub use filter::FilterRule;
pub use batch::BatchManager;
pub use batch::Batch;
pub use optimized_collector::OptimizedTextCollector;
pub use optimized_collector::OptimizedTextItem;
pub use optimized_collector::BatchTextProcessor;
pub use concurrent_batch::ConcurrentBatchProcessor;
pub use concurrent_batch::AdaptiveBatchProcessor;
pub use concurrent_batch::BatchConfig;
pub use concurrent_batch::BatchTask;
pub use concurrent_batch::BatchResult;
pub use concurrent_batch::Priority;
pub use concurrent_batch::BatchProcessingStats;
pub use concurrent_batch::QueueStatus;

Modules§

batch
批次管理模块
collector
文本收集器模块
concurrent_batch
并发批处理模块
filter
文本过滤器模块
optimized_collector
优化的DOM遍历实现