Struct ClientRpcLlmInference 

pub struct ClientRpcLlmInference<'a> { /* private fields */ }

llmInference.* RPCs.

Implementations

impl<'a> ClientRpcLlmInference<'a>

pub async fn set_provider(&self) -> Result<LlmInferenceSetProviderResult, Error>

Registers an SDK client as the LLM inference callback provider.

Wire method: llmInference.setProvider.

Returns

Indicates whether the calling client was registered as the LLM inference provider.

Experimental. This API is part of an experimental wire-protocol surface and may change or be removed in future SDK or CLI releases. Pin both the SDK and CLI versions if your code depends on it.

pub async fn http_response_start( &self, params: LlmInferenceHttpResponseStartRequest, ) -> Result<LlmInferenceHttpResponseStartResult, Error>

Delivers the response head (status + headers) for an in-flight request, correlated by the requestId the runtime supplied in httpRequestStart. Must be called exactly once per request before any httpResponseChunk frames.

Wire method: llmInference.httpResponseStart.

Parameters

• params - Response head.

Returns

Whether the start frame was accepted.

Experimental. This API is part of an experimental wire-protocol surface and may change or be removed in future SDK or CLI releases. Pin both the SDK and CLI versions if your code depends on it.

pub async fn http_response_chunk( &self, params: LlmInferenceHttpResponseChunkRequest, ) -> Result<LlmInferenceHttpResponseChunkResult, Error>

Delivers a body byte range (or a terminal transport error) for an in-flight response, correlated by requestId. Set end true on the last chunk. When error is set the response terminates with a transport-level failure and the runtime raises an APIConnectionError.

Wire method: llmInference.httpResponseChunk.

Parameters

• params - A response body chunk or terminal error.

Returns

Whether the chunk was accepted.

Experimental. This API is part of an experimental wire-protocol surface and may change or be removed in future SDK or CLI releases. Pin both the SDK and CLI versions if your code depends on it.

Trait Implementations

impl<'a> Clone for ClientRpcLlmInference<'a>

fn clone(&self) -> ClientRpcLlmInference<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for ClientRpcLlmInference<'a>