Skip to main content

Utf8StreamDecoder

Struct Utf8StreamDecoder 

Source
pub struct Utf8StreamDecoder { /* private fields */ }
Expand description

Incrementally decodes a byte stream into UTF-8 text.

Chunks can split a multibyte code point (CJK, emoji, accented characters, smart quotes) across boundaries. Decoding each chunk independently with String::from_utf8_lossy corrupts such code points into U+FFFD replacement characters. This decoder buffers any trailing incomplete sequence until the rest of its bytes arrive, while still replacing genuinely invalid bytes with U+FFFD (matching from_utf8_lossy semantics). Call Utf8StreamDecoder::finish at end of stream so a truncated final sequence becomes U+FFFD instead of vanishing.

Implementations§

Source§

impl Utf8StreamDecoder

Source

pub fn new() -> Self

Source

pub fn push(&mut self, bytes: &[u8]) -> String

Appends bytes and returns the decodable UTF-8 prefix. A trailing incomplete multibyte sequence is retained for the next call.

Source

pub fn push_cow<'a>(&mut self, bytes: &'a [u8]) -> Cow<'a, str>

Like Utf8StreamDecoder::push, but borrows bytes without copying when nothing is pending and the chunk is valid UTF-8 (the common case for process output), so hot read loops avoid a per-chunk allocation.

Source

pub fn push_bytes(&mut self, bytes: &[u8], out: &mut Vec<u8>)

Appends bytes and writes the decodable UTF-8 prefix directly into out. A trailing incomplete multibyte sequence is retained for the next call.

This avoids the intermediate String allocation that push creates when the caller only needs bytes (e.g. feeding an SSE byte buffer).

Source

pub fn finish(&mut self) -> String

Ends the stream: returns any retained incomplete sequence lossily decoded (as U+FFFD), leaving the decoder empty.

Trait Implementations§

Source§

impl Debug for Utf8StreamDecoder

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for Utf8StreamDecoder

Source§

fn default() -> Self

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more