Module middleware 

Middleware hooks for LLMClient request/response lifecycle. Middleware hooks for LLMClient request/response lifecycle.

Provides an LLMClientMiddleware trait with hooks that fire before each request, after each successful response, and on each error.

The MiddlewareClient wrapper composes with any LLMClient, including RetryClient.

Example

use llm_kernel::llm::{LLMClient, MiddlewareClient, NoopMiddleware};

let client = OpenAIClient::from_key("gpt-4o", "sk-...")?;
let middleware = NoopMiddleware;
let wrapped = MiddlewareClient::new(client, middleware);
let response = wrapped.complete(request).await?;

Structs

MiddlewareClient

An LLMClient wrapper that calls LLMClientMiddleware hooks around each request.

NoopMiddleware

A default no-op middleware. Useful as a type parameter default.

Traits

LLMClientMiddleware

Hook trait for intercepting LLMClient request/response cycles.