Struct StreamContext 

pub struct StreamContext {
    pub text: *const u8,
    pub text_len: u32,
    pub agent_type: AgentType,
    pub stream_id: u32,
    pub timestamp: u64,
    pub is_continuation: bool,
    pub enable_ansi: bool,
    /* private fields */
}

Stream context for AI agent responses.

This structure contains all metadata needed to process a message through the GPU pipeline. It’s designed to be POD (Plain Old Data) for safe FFI transmission to CUDA kernels.

Memory Layout

Uses #[repr(C)] to ensure C-compatible memory layout for FFI. The structure is carefully padded to avoid alignment issues.

Safety

The text pointer must remain valid for the duration of kernel execution. Typically, this is ensured by keeping the source data alive in the caller.

Fields

text: *const u8

text_len: u32

agent_type: AgentType

stream_id: u32

timestamp: u64

is_continuation: bool

enable_ansi: bool

Implementations

impl StreamContext

pub fn new(text: &[u8], agent_type: AgentType) -> Self

Trait Implementations

impl Clone for StreamContext

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for StreamContext

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.