Skip to main content

llm_call_execute

nemo_flow::api::llm

Function llm_call_execute 

Source 
pub async fn llm_call_execute(params: LlmCallExecuteParams) -> Result<Json>
Expand description

Execute an LLM call through the managed middleware pipeline.

This runs conditional-execution guardrails, request intercepts, sanitize-request guardrails, execution intercepts, the provider callback, and sanitize-response guardrails in the runtime-defined order.

§Parameters

  • name: Logical provider or model family name recorded on emitted events.
  • request: Raw LlmRequest passed into the managed pipeline.
  • func: Provider callback or execution continuation.
  • parent: Optional explicit parent scope for the emitted LLM span.
  • attributes: LLM attribute bitflags applied to the managed span.
  • data: Optional application payload stored on the managed LLM handle. It may be used on failure end events that have no output payload.
  • metadata: Optional JSON metadata recorded on emitted events.
  • model_name: Optional normalized model name for observability output.
  • codec: Optional request codec used to produce annotated request data for intercepts and events.
  • response_codec: Optional response codec used to attach annotated response data to the end event.

§Returns

A Result containing the raw JSON response returned by the callback or an execution intercept.

§Errors

Returns FlowError::GuardrailRejected when conditional-execution guardrails block the call, or any error raised by request intercepts, execution intercepts, codecs, or the callback itself.

§Notes

Response codecs enrich observability output only and do not change the value returned to the caller.