Skip to main content

NemoRelayNativeLlmStreamPollFn

Type Alias NemoRelayNativeLlmStreamPollFn 

Source
pub type NemoRelayNativeLlmStreamPollFn = unsafe extern "C" fn(user_data: *mut c_void, out_json: *mut *mut NemoRelayNativeString) -> NemoRelayStatus;
Expand description

Native stream poll callback.

Return NemoRelayStatus::Ok with out_json set for one chunk, NemoRelayStatus::StreamEnd with out_json null at end of stream, or an error status for stream failure.