Struct StreamingDecoder 

pub struct StreamingDecoder { /* private fields */ }

Buffered decoder for newline-delimited JSON streams (NDJSON).

Accumulates raw bytes, splits on newline boundaries, and yields complete JSON lines. Handles the common case where a single JSON object is split across multiple network chunks.

Example

use llm_pipeline::StreamingDecoder;

let mut decoder = StreamingDecoder::new();

// First chunk: partial JSON
let values = decoder.decode(b"{\"response\":");
assert!(values.is_empty());

// Second chunk: completes the line
let values = decoder.decode(b"\"hello\"}\n");
assert_eq!(values.len(), 1);
assert_eq!(values[0]["response"], "hello");

Implementations

impl StreamingDecoder

pub fn new() -> Self

Create a new empty decoder.

pub fn decode(&mut self, chunk: &[u8]) -> Vec<Value>

Feed a raw chunk into the decoder and return any complete JSON lines.

Each returned value is a parsed JSON Value from one complete line. Incomplete lines are buffered until the next chunk arrives.

pub fn flush(&mut self) -> Option<Value>

Flush remaining buffer content, attempting to parse it as JSON.

Call this after the stream ends to handle any trailing data not terminated by a newline. If direct parsing fails, attempts auto-completion of truncated JSON (closing unclosed strings, brackets, and braces).

Trait Implementations

impl Default for StreamingDecoder

fn default() -> Self

Returns the “default value” for a type.