Module llm 

LLM lifecycle helpers and managed execution entry points.

Structs

CreateLlmHandleParams

Builder parameters for NemoFlowContextState::create_llm_handle.

EndLlmHandleParams

Builder parameters for NemoFlowContextState::build_llm_end_event.

LlmAttributes

Bitflags that modify LLM-call behavior and observability.

LlmCallEndParams

Builder parameters for llm_call_end.

LlmCallExecuteParams

Builder parameters for llm_call_execute.

LlmCallParams

Builder parameters for llm_call.

LlmHandle

Runtime-owned handle identifying an active or completed LLM call.

LlmRequest

JSON-shaped LLM request payload passed through the runtime.

LlmStreamCallExecuteParams

Builder parameters for llm_stream_call_execute.

Functions

llm_call

Start a manual LLM lifecycle span.

llm_call_end

Finish a manual LLM lifecycle span.

llm_call_execute

Execute an LLM call through the managed middleware pipeline.

llm_conditional_execution

Run only the LLM conditional-execution guardrail chain.

llm_request_intercepts

Run only the LLM request-intercept chain.

llm_stream_call_execute

Execute a streaming LLM call through the managed middleware pipeline.