Module middleware 

Middleware hooks for LLMClient request/response lifecycle. Middleware hooks for LLMClient request/response lifecycle.

Provides an LLMClientMiddleware trait with hooks that fire before each request, after each successful response, and on each error.

The MiddlewareClient wrapper composes with any LLMClient, including [RetryClient].

Example

use llm_kernel::llm::{LLMClient, MiddlewareClient, NoopMiddleware};

let client = OpenAIClient::from_key("gpt-4o", "sk-...")?;
let middleware = NoopMiddleware;
let wrapped = MiddlewareClient::new(client, middleware);
let response = wrapped.complete(request).await?;

Structs

MiddlewareClient

An LLMClient wrapper that calls LLMClientMiddleware hooks around each request.

NoopMiddleware

A default no-op middleware. Useful as a type parameter default.

Traits

LLMClientMiddleware

Hook trait for intercepting LLMClient request/response cycles.