batchflow 0.0.0

A production-grade batch processing framework for Rust, inspired by Spring Batch. Under active development — name reservation release.
Documentation
  • Coverage
  • 100%
    1 out of 1 items documented0 out of 0 items with examples
  • Size
  • Source code size: 44.3 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 18.0 kB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 2s Average build duration of successful builds.
  • all releases: 2s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • crates.io
  • Dependencies
  • Versions
  • Owners
  • devcalm

BatchFlow

A production-grade batch processing framework for Rust, inspired by Spring Batch but designed around idiomatic Rust: traits, ownership, Result-based error handling, and an async-first execution engine.

BatchFlow owns the orchestration layer — execution engine, chunk processing, fault tolerance, restartability, and metadata persistence — while integrating mature crates from the Rust ecosystem for everything else (async runtime, database access, serialization, tracing, metrics).

⚠️ Status: under active development

This 0.0.0 release reserves the crate name while the framework is being designed and built in the open. It is not yet usable. The API is unstable and will change.

Planned capabilities

  • Chunk-oriented processing (read → process → write) with configurable commit intervals
  • Trait-based ItemReader / ItemProcessor / ItemWriter abstractions
  • Durable job metadata with pluggable storage backends (in-memory, PostgreSQL, Redis)
  • Restartability with checkpoint/bookmark semantics
  • Retry and skip policies with error classification
  • Metrics (metrics/Prometheus) and tracing (tracing/OpenTelemetry)
  • Integration with external schedulers (cron, Kubernetes CronJobs) rather than a bespoke scheduler

License

Licensed under either of

at your option.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in this work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.