pipebase 0.1.0

A tokio based runtime library for data integration app

pipebase is a tokio based runtime library for data integration app. It provides basic pipes implemented with rust standard library.

Basic Pipes

Here is a list of basic pipes built in pipebase

pipe type	implementation	example
`Exporter`	`Printer`	`printer`
`Poller`	`Timer`	`timer`
`Listener`	`LocalFilePathVisitor`	`file_path`
`Streamer`	`FileLineReader`	`stateless_word_count`
`Streamer`	`IteratorReader`	`stateless_word_count`
`Mapper`	`FieldVisit`	`field_filter`
`Mapper`	`FilterMap`	`field_filter`
`Mapper`	`StringSplitter`	`stateless_word_count`
`Mapper`	`Projection`	`project_file`
`Mapper`	`FileReader`	`project_file`
`Mapper`	`FileWriter`	`convert_csv`
`Mapper`	`Conversion`	`convert_csv`
`Selector`	`RandomSelector`	`ingest_redis_parallel`
`Collector`	`TextCollector`	`ingest_elasticsearch`