Struct StreamableParser

pub struct StreamableParser { /* private fields */ }

Incremental parser that can consume tokens one by one.

It keeps track of all tokens seen so far, exposes all fully parsed messages and retains the partially parsed state of the current message.

Implementations

impl StreamableParser

pub fn new(encoding: HarmonyEncoding, role: Option<Role>) -> Result<Self>

Create a new streaming parser starting with the given role.

pub fn process(&mut self, token: u32) -> Result<&mut Self>

pub fn process_eos(&mut self) -> Result<&mut Self>

pub fn current_content(&self) -> Result<String>

Return the textual content of the current message so far.

pub fn current_role(&self) -> Option<Role>

Role of the current message if it has been parsed.

pub fn current_content_type(&self) -> Option<String>

Current content type if known.

pub fn last_content_delta(&self) -> Result<Option<String>>

Decode the last content delta if available.

pub fn into_messages(self) -> Vec<Message>

Consume the parser and return all parsed messages.

pub fn messages(&self) -> &[Message]

All fully parsed messages so far.

pub fn tokens(&self) -> &[u32]

All tokens that were fed into the parser.

pub fn state_json(&self) -> Result<String>

Expose the current state as a JSON string for Python interop.

pub fn current_recipient(&self) -> Option<String>

Return the current recipient if known.

pub fn current_channel(&self) -> Option<String>

Return the current channel if known.