Struct FunctionInvokingChatClient 

pub struct FunctionInvokingChatClient<C>
where
    C: ChatClient,
{ /* private fields */ }

Wraps a ChatClient to automatically execute local tool calls in a loop, mirroring use_function_invocation.

Implementations

impl<C> FunctionInvokingChatClient<C>

where C: ChatClient,

pub fn new(inner: C) -> FunctionInvokingChatClient<C>

pub fn with_observability_config( self, observability: ObservabilityConfig, ) -> FunctionInvokingChatClient<C>

Set the ObservabilityConfig governing this client’s execute_tool spans. Pass the same config given to an ObservableChatClient wrapping the same stack, so one trace reports one semantic-convention version throughout.

pub fn with_config( self, config: FunctionInvocationConfig, ) -> FunctionInvokingChatClient<C>

Override the function-invocation configuration.

pub fn with_function_middleware( self, middleware: Vec<Arc<dyn Middleware<FunctionInvocationContext>>>, ) -> FunctionInvokingChatClient<C>

Configure the function-invocation middleware pipeline run around every tool call: middleware may inspect/rewrite FunctionInvocationContext::arguments, short-circuit execution by setting FunctionInvocationContext::result (and either not calling next, or setting terminate = true), or observe a propagated execution error by matching on the Result returned from their own next.run(...) call. Replaces any previously configured middleware.

pub fn inner(&self) -> &C

A reference to the wrapped client.

Trait Implementations

impl<C> ChatClient for FunctionInvokingChatClient<C>

where C: ChatClient,

fn get_response<'life0, 'async_trait>( &'life0 self, messages: Vec<Message>, options: ChatOptions, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, Error>> + Send + 'async_trait>>

where 'life0: 'async_trait, FunctionInvokingChatClient<C>: 'async_trait,

Get a complete (non-streaming) response.

fn get_streaming_response<'life0, 'async_trait>( &'life0 self, messages: Vec<Message>, options: ChatOptions, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<ChatResponseUpdate, Error>> + Send>>, Error>> + Send + 'async_trait>>

where 'life0: 'async_trait, FunctionInvokingChatClient<C>: 'async_trait,

Get a streaming response as a sequence of updates.

fn model(&self) -> Option<&str>

The default model id for this client, if any.