Module engine 

Available on crate feature worker-batch and (crate features worker-batch or worker-pool or worker) only.

Re-exports

pub use config::BatchProcessingConfig;

pub use config::ParseErrorAction;

pub use config::PreRouteFilterConfig;

pub use intern::FieldInterner;

pub use types::MessageMetadata;

pub use types::ParsedMessage;

pub use types::PreRouteResult;

pub use types::RawMessage;

Modules

config

intern

Field name interning for the batch processing engine.

metrics

parse

Parse phase: convert raw bytes into a sonic_rs::Value using SIMD acceleration. This is the most CPU-intensive phase (~1-5 µs per message).

pre_route

Pre-route phase: extract a routing field from raw JSON bytes using sonic_rs::get_from_slice (SIMD-accelerated), then apply filters to decide whether the message continues, is dropped, or goes to DLQ.

types

Structs

BatchEngine

Core batch processing engine for DFE pipelines.

Enums

EngineErrortransport

Errors returned by BatchEngine::run and BatchEngine::run_raw.

FilterDlqPolicytransport

What a BatchEngine run loop does with inbound-filter DLQ entries (RecvBatch::dlq_entries).