Struct NativeEncoder 

pub struct NativeEncoder<F> { /* private fields */ }

Encodes a record family’s Serialize rows into the ClickHouse Native format. Runs on pipeline threads inside the terminal stage; buffers rows columnar in encode and emits one block per chunk in finish_chunk.

F is the record family: Owned<T> for plain owned row structs (NativeEncoder::<Owned<MyRow>>::new(schema)), or a borrowed family for zero-copy pipelines — any family whose records implement Serialize at every lifetime encodes.

Cloning mints a fresh, empty encoder over the same schema — the terminal stage clones one per shard.

Implementations

impl<F> NativeEncoder<F>

pub fn new(schema: Arc<NativeSchema>) -> Self

A Native encoder for the columns described by schema.

pub fn from_row_schema(schema: &RowSchema) -> Result<Self, NativeError>

Build directly from a validated RowSchema.

Trait Implementations

impl<F> Clone for NativeEncoder<F>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<F> Debug for NativeEncoder<F>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<F> RowEncoder<F> for NativeEncoder<F>

where F: RecFamily, for<'b> F::Rec<'b>: Serialize,

fn encode<'buf>( &mut self, rec: &Record<F::Rec<'buf>>, _buf: &mut BytesMut, ) -> Result<(), SinkError>

Append rec’s encoding to buf. Errors are record-level and subject to the sink stage’s ErrorPolicy — except errors of ErrorClass::Fatal, which stop the pipeline regardless of policy (fatal means the encoder itself is broken, e.g. the row type cannot match the target schema; every subsequent record would fail identically).

fn buffered_bytes(&self) -> usize

Bytes the encoder is holding internally that have not yet been flushed to a frame. Row formats append directly in encode and buffer nothing, so the default is 0. Columnar formats (which must transpose a whole block before any bytes exist) return the approximate size of the block under assembly; the terminal stage adds this to the shard buffer length when deciding whether to seal a chunk, so a columnar block still respects ChunkConfig::target_bytes.

fn finish_chunk(&mut self, buf: &mut BytesMut) -> Result<(), SinkError>

Finalize the pending chunk: flush any internally-buffered rows into buf as exactly one complete, self-describing wire frame, leaving the encoder empty and ready for the next chunk. Row formats already wrote every row in encode, so the default is a no-op. The terminal stage calls this immediately before it seals each EncodedChunk — in steady state, on data lulls, and at drain — so a columnar encoder’s buffered rows are never silently dropped.