Struct SourceDecoder 

pub struct SourceDecoder {
    pub dropped: u64,
    pub rescued: u64,
    /* private fields */
}

The decoder for one source: holds the resolved schema once it is known.

Fields

dropped: u64

rescued: u64

Implementations

impl SourceDecoder

pub fn new(policy: SourcePolicy) -> SourceDecoder

pub fn with_shared(self, slot: Arc<OnceLock<Arc<Schema>>>) -> SourceDecoder

Share the inferred schema with the source’s other tasks through slot: whoever infers first publishes it, everyone else adopts it (a declared schema needs no slot).

pub fn schema(&self) -> Option<&Arc<Schema>>

The schema every batch from this source has (after the first inference, if inferred).

pub fn decode( &mut self, msgs: &[(Option<String>, i64, Vec<u8>)], ) -> Result<Decoded, ArrowError>

Decode one partition’s messages (key, offset, payload) into a batch plus aligned offsets.