1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141
#![cfg_attr(docsrs, feature(doc_cfg))]
//#![warn(missing_docs)]
/*!
<div align="center">
<h1>Spring-Batch for Rust</h1>
<h3>🐞 A toolkit for building enterprise-grade batch applications</h3>
[](https://crates.io/crates/spring-batch-rs)
[](https://docs.rs/spring-batch-rs)
[](https://github.com/sboussekeyt/spring-batch-rs/actions/workflows/rust.yml)
[](https://discord.gg/9FNhawNsG6)
[](https://codecov.io/gh/sboussekeyt/spring-batch-rs)

</div>
# Spring-Batch for Rust
Spring Batch for Rust, offers a robust and flexible framework for the development of batch processing applications, addressing the challenges of handling large-scale data processing tasks efficiently and reliably. It provides developers a comprehensive toolkit for building enterprise-grade batch applications.
## Features
+ CSV reader and writer
+ JSON reader and writer
## Roadmap
+ XML reader and writer
+ SQL reader and writer
+ MongoDB reader and writer
+ Kafka reader and writer
+ Pulsar reader and writer
+ Retry/Skip policies
+ Save execution data in database
## Example
```toml
[dependencies]
spring-batch-rs = { version = "0.1.1", features = ["full"] }
```
Then, on your main.rs:
```rust,no_run
# use std::fmt;
# use serde::{Deserialize, Serialize};
# use spring_batch_rs::{
# core::step::{Step, StepBuilder},
# item::csv::csv_reader::CsvItemReaderBuilder,
# error::BatchError,
# item::logger::LoggerWriter,
# };
#[derive(Deserialize, Serialize, Debug, Clone)]
struct Record {
year: u16,
make: String,
model: String,
description: String,
}
impl fmt::Display for Record {
fn fmt(&self, f: &mut fmt::Formatter<'_>) -> fmt::Result {
write!(
f,
"(year={}, make={}, model={}, description={})",
self.year, self.make, self.model, self.description
)
}
}
fn main() -> Result<(), BatchError> {
let csv = "year,make,model,description
1948,Porsche,356,Luxury sports car
1967,Ford,Mustang fastback 1967,American car";
let mut reader = CsvItemReaderBuilder::new().delimiter(b',').from_reader(csv.as_bytes());
let mut writer = LoggerWriter::new();
let mut step: Step<Record, Record> = StepBuilder::new()
.reader(&mut reader)
.writer(&mut writer)
.chunk(4)
.build();
step.execute();
Ok(())
}
```
### Read CSV file with headers
```sh
$ git clone git://github.com/sboussekeyt/spring-batch-rs
$ cd spring-batch-rs
$ cargo run --example csv_reader_with_headers --all-features < examples/data/cars_with_headers.csv
```
### Read Json file
```sh
$ git clone git://github.com/sboussekeyt/spring-batch-rs
$ cd spring-batch-rs
$ cargo run --example json_reader --all-features < examples/data/persons.json
```
## License
Licensed under either of
- Apache License, Version 2.0
([LICENSE-APACHE](LICENSE-APACHE) or <http://www.apache.org/licenses/LICENSE-2.0>)
- MIT license
([LICENSE-MIT](LICENSE-MIT) or <http://opensource.org/licenses/MIT>)
at your option.
## Contribution
Unless you explicitly state otherwise, any contribution intentionally submitted
for inclusion in the work by you, as defined in the Apache-2.0 license, shall be
dual licensed as above, without any additional terms or conditions
*/
pub mod core;
/// Error types for batch operations
pub mod error;
/// Set of items readers / writers (for exemple: csv reader and writer)
pub mod item;
#[doc(inline)]
pub use error::*;
#[cfg(feature = "logger")]
#[doc(inline)]
pub use item::logger::*;
#[cfg(feature = "csv")]
#[doc(inline)]
pub use item::csv::{csv_reader::*, csv_writer::*};
#[cfg(feature = "json")]
#[doc(inline)]
pub use item::json::{json_reader::*, json_writer::*};