#[repr(C)]pub struct NemoRelayNativeLlmStreamV1 {
pub struct_size: usize,
pub user_data: *mut c_void,
pub next: Option<NemoRelayNativeLlmStreamPollFn>,
pub cancel: NemoRelayNativeLlmStreamCancelFn,
pub drop: NemoRelayNativeLlmStreamDropFn,
}Expand description
Native LLM JSON stream handle table.
Fields§
§struct_size: usizeSize of this struct as seen by the producer.
user_data: *mut c_voidStream state passed back to poll/cancel/drop callbacks.
next: Option<NemoRelayNativeLlmStreamPollFn>Polls the next stream chunk.
cancel: NemoRelayNativeLlmStreamCancelFnCancels an in-flight stream when a consumer stops before stream end.
drop: NemoRelayNativeLlmStreamDropFnDrops stream state after stream completion, error, or cancellation.
Trait Implementations§
Auto Trait Implementations§
impl !Send for NemoRelayNativeLlmStreamV1
impl !Sync for NemoRelayNativeLlmStreamV1
impl Freeze for NemoRelayNativeLlmStreamV1
impl RefUnwindSafe for NemoRelayNativeLlmStreamV1
impl Unpin for NemoRelayNativeLlmStreamV1
impl UnsafeUnpin for NemoRelayNativeLlmStreamV1
impl UnwindSafe for NemoRelayNativeLlmStreamV1
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more