Skip to main content

StreamingJsonlDecoder

Struct StreamingJsonlDecoder 

Source
pub struct StreamingJsonlDecoder { /* private fields */ }
Expand description

Push-based JSONL decoder. Accumulates bytes between calls to Self::feed, splits on \n, parses each completed line as a JSON object, and queues the resulting record for Self::drain.

Implementations§

Trait Implementations§

Source§

impl Default for StreamingJsonlDecoder

Source§

fn default() -> StreamingJsonlDecoder

Returns the “default value” for a type. Read more
Source§

impl StreamingRowDecoder for StreamingJsonlDecoder

Source§

fn feed(&mut self, chunk: &[u8]) -> Result<(), Error>

Append a chunk of bytes to the internal buffer and parse any records that became complete. Idempotent: feeding zero bytes is a no-op.
Source§

fn drain(&mut self) -> Result<Vec<Vec<(String, LoraValue)>>, Error>

Pull all records completed since the previous drain / finish call. Returns an empty Vec when no full record has been parsed yet.
Source§

fn finish(&mut self) -> Result<Vec<Vec<(String, LoraValue)>>, Error>

Signal that no more bytes will be fed. Returns any records emitted by handling the residual buffer — for JSONL/CSV this covers the case where the file ends without a trailing newline.
Source§

fn header(&self) -> Option<&[String]>

Column names declared in the file header. Populated after the first record arrives for CSV; always None for JSONL.
Source§

fn bytes_fed(&self) -> u64

Total bytes accepted via feed since construction. Used for progress reporting.
Source§

fn rows_emitted(&self) -> u64

Total records emitted via drain + finish so far.
Source§

fn set_permissive(&mut self, on: bool)

Switch the decoder into permissive mode. In permissive mode, per-record parse failures are accumulated for retrieval via Self::take_errors instead of bubbling out of feed / finish. Fatal errors (encoding issues that desync the byte stream itself) still bubble. Must be called before the first feed; later calls take effect at the next record boundary. Default impl is a no-op for decoders that don’t support it.
Source§

fn take_errors(&mut self) -> Vec<RowParseError>

Drain the parse errors accumulated since the previous call. Empty when permissive mode is off or no failures occurred.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more