Expand description
Async middleware for LLM-compatible tool execution
Proper composition pattern with async/await support. Suitable for tokio-based systems handling LLM operations.
Structs§
- Async
Caching Middleware - Async caching middleware with UnifiedCache (migrated from LruCache)
- Async
Logging Middleware - Async logging middleware
- Async
Middleware Chain - Async middleware chain executor
- Async
Retry Middleware - Async retry middleware with exponential backoff
- Tool
Request - Tool request
- Tool
Result - Tool result
Traits§
- Async
Middleware - Async middleware trait