Struct SseFormatter 

pub struct SseFormatter {
    pub include_usage: bool,
    /* private fields */
}

Stateless SSE event formatter.

Produces correctly framed data: …\n\n strings for each stage of a streaming generation response.

Fields

include_usage: bool

Whether to append a usage chunk after the final delta.

Implementations

impl SseFormatter

pub fn new(model_name: &str) -> Self

Create a new formatter for the given model.

pub fn with_usage(self) -> Self

Enable a trailing usage chunk.

pub fn first_chunk(&self, request_id: &str) -> String

Format the first chunk of a streaming response.

The first chunk carries role: "assistant" and an empty content string so that clients can render the role indicator immediately.

pub fn token_chunk(&self, request_id: &str, token_text: &str) -> String

Format a token delta chunk carrying token_text as the content.

pub fn final_chunk(&self, request_id: &str, finish_reason: &str) -> String

Format the final chunk carrying the finish_reason and no content.

pub fn done_sentinel() -> &'static str

The SSE [DONE] sentinel that signals stream completion.

pub fn format_event(data: &str) -> String

Wrap arbitrary JSON data in a data: …\n\n SSE frame.

pub fn error_event(message: &str) -> String

Format a JSON error payload as an SSE event.