af-llm

Unified async LLM client with retry, timeout and circuit breaking. Talks to any OpenAI-compatible endpoint (LiteLLM proxy, DeepSeek, Anthropic-via-proxy, ...).

Install

cargo add af-llm

Use the exact Agent Factory version across packages in one application.

Scope

This package owns reusable, business-free infrastructure and lifecycle contracts. Product prompts, domain tools, policies, credentials, data, and deployment configuration remain in the consuming application.

Documentation

API and package documentation: https://docs.rs/af-llm