Expand description
Hugging Face Text Generation Inference (TGI) adapter via OAI-compatible endpoint.
TGI exposes an OpenAI-compatible /v1/chat/completions endpoint from v2+.
Older deployments may only expose /generate; this adapter targets the modern OAI-compatible path,
which is the recommended production interface.
Optional bearer credentials are configured through Config::api_key as a redacting SecretString
and installed through rskit-httpclient auth rather than raw headers.
Structs§
- Config
- Configuration for the TGI OAI-compatible adapter.
Functions§
- register
- Explicitly register the TGI adapter factory.