Struct CustomChunker

pub struct CustomChunker<R: AsyncRead, A> { /* private fields */ }

Available on crate feature async only.

The async analog to the base crate’s CustomChunker. It takes an Adapter and yields chunks based on the Adapter’s transformation.

    use regex_chunker::{
        stream::ByteChunker,
        StringAdapter,
    };
    use tokio_stream::StreamExt;
    use std::io::Cursor;

    let text = b"One, two, three four. Can I have a little more?";
    let c = Cursor::new(text);

    let chunks: Vec<_> = ByteChunker::new(c, "[ .,?]+")?
        .with_adapter(StringAdapter::default())
        .map(|res| res.unwrap())
        .collect().await;

    assert_eq!(
        &chunks,
        &[
            "One", "two", "three", "four",
            "Can", "I", "have", "a", "little", "more"
        ].clone()
    );

Implementations

impl<R: AsyncRead, A> CustomChunker<R, A>

pub fn into_innards(self) -> (ByteChunker<R>, A)

Consumes the CustomChunker and returns the underlying ByteChunker and Adapter.

pub fn get_adapter(&self) -> &A

Get a reference to the underlying Adapter.

pub fn get_adapter_mut(&mut self) -> &mut A

Get a mutable reference to the underlying Adapter.

Trait Implementations

impl<R, A> Stream for CustomChunker<R, A>

where R: AsyncRead + Unpin, A: Adapter,

type Item = <A as Adapter>::Item

Values yielded by the stream.

fn poll_next( self: Pin<&mut Self>, cx: &mut Context<'_>, ) -> Poll<Option<Self::Item>>

Attempt to pull out the next value of this stream, registering the current task for wakeup if the value is not yet available, and returning None if the stream is exhausted.

fn size_hint(&self) -> (usize, Option<usize>)

Returns the bounds on the remaining length of the stream.

impl<R: AsyncRead, A> Unpin for CustomChunker<R, A>