pub type NemoRelayNativeAsyncLlmStreamPullCb = unsafe extern "C" fn(user_data: *mut c_void, chunk_json: *const NemoRelayNativeString, error: *const NemoRelayNativeString, done: bool);Expand description
Receives one item from a pull-based downstream LLM stream.
A chunk has non-null chunk_json and done = false; clean completion has
both strings null and done = true; failure has non-null error and
done = true. Only one pull may be outstanding per stream.