rskit-inference-tgi 0.2.0-alpha.3

Hugging Face TGI REST adapter for rskit-inference
Documentation

rskit-inference-tgi

Hugging Face TGI REST adapter for rskit-inference.

This crate implements the OAI-compatible /v1/chat/completions path with explicit register(&mut Registry, Config) factory wiring. It performs no auto-registration and has no global registry.

Configuration notes

  • Config::api_key is an optional SecretString; debug/serialization output is redacted.
  • When configured, the token is installed through rskit-httpclient::Auth::bearer_secret, not a raw header, so HTTP client config debug output does not expose credentials.
  • The adapter targets the OpenAI-compatible TGI endpoint and keeps registration explicit through register.