Trait StreamCodec

Source

pub trait StreamCodec: Send + Sync {
    // Required methods
    fn format(&self) -> FormatId;
    fn decode_event(
        &self,
        state: &mut StreamTranslationState,
        event: &Value,
    ) -> Vec<LlmStreamEvent>;
    fn encode_event(
        &self,
        state: &mut StreamTranslationState,
        event: LlmStreamEvent,
    ) -> Vec<Value>;
    fn finish(&self, state: &mut StreamTranslationState) -> Vec<Value>;
}

Expand description

Codec contract for one provider streaming event format.

Required Methods§

Source

fn format(&self) -> FormatId

Returns the stream format handled by this codec.

Source

fn decode_event( &self, state: &mut StreamTranslationState, event: &Value, ) -> Vec<LlmStreamEvent>

Decodes one provider event into zero or more neutral events.

Source

fn encode_event( &self, state: &mut StreamTranslationState, event: LlmStreamEvent, ) -> Vec<Value>

Encodes one neutral event into zero or more provider events.

Source

fn finish(&self, state: &mut StreamTranslationState) -> Vec<Value>

Emits any terminal provider events needed after the source stream ends.

This is intentionally required on every codec. Some target formats need explicit terminal events after the source closes (for example, Anthropic message_delta/message_stop or Responses response.completed). Formats that have no source-close work should return an empty vector explicitly so the no-op behavior is a conscious codec-level choice.