Skip to main content

Module engine

Module engine 

Source
Available on (crate features worker-pool or worker-batch or worker) and crate feature worker-batch only.

Re-exports§

pub use config::BatchProcessingConfig;
pub use config::ParseErrorAction;
pub use config::PreRouteFilterConfig;
pub use intern::FieldInterner;
pub use types::MessageMetadata;
pub use types::ParsedMessage;
pub use types::PreRouteResult;
pub use types::RawMessage;

Modules§

config
intern
Field name interning for the batch processing engine.
metrics
parse
Parse phase: convert raw bytes into a sonic_rs::Value using SIMD acceleration. This is the most CPU-intensive phase (~1-5 µs per message).
pre_route
Pre-route phase: extract a routing field from raw JSON bytes using sonic_rs::get_from_slice (SIMD-accelerated), then apply filters to decide whether the message continues, is dropped, or goes to DLQ.
types

Structs§

BatchEngine
Core batch processing engine for DFE pipelines.

Enums§

EngineErrortransport
Errors returned by BatchEngine::run and BatchEngine::run_raw.