Crate oxigdal_streaming 

Real-time data processing and streaming pipelines for OxiGDAL.

This crate provides a comprehensive streaming framework for processing geospatial data in real-time. It includes:

• Stream traits and abstractions with backpressure handling
• Windowing and watermarking for event-time processing
• Rich set of transformations (map, filter, join, etc.)
• Stateful operations with checkpointing
• State backends (RocksDB) for fault tolerance

Example

use oxigdal_streaming::core::Stream;
use oxigdal_streaming::transformations::MapTransform;

// Create a stream and apply transformations
// let stream = Stream::new();
// let transformed = stream.map(|x| x * 2).filter(|x| x > 10);

Re-exports

pub use error::Result;

pub use error::StreamingError;

Modules

core

Core streaming abstractions and traits.

error

Error types for the streaming module.

metrics

Metrics collection and monitoring for streaming operations.

state

State management for stateful stream processing.

transformations

Stream transformations and operations.

windowing

Windowing and watermarking for event-time processing.