Crate regex_chunker

source ·

Re-exports

  • pub use crate::err::RcErr;

Modules

  • Error types returned by the various chunkers.

Structs

  • The ByteChunker takes a bytes::Regex, wraps a byte source (that is, a type that implements std::io::Read) and iterates over chunks of bytes from that source that are delimited by the regular expression. It operates very much like bytes::Regex::split, except that it works on an incoming stream of bytes instead of a necessarily-already-in-memory slice.
  • The StringChunker operates like the ByteChunker, except instead of returning Vec<u8>s, it returns Strings. It also has an extra parameter of operation, Utf8FailureMode, which controls how it reacts when reading data that is not valid UTF-8.

Enums