Expand description
vLLM inference adapter using the OAI-compatible /v1/completions endpoint.
Optional bearer credentials are configured through Config::api_key as a redacting SecretString
and installed through rskit-httpclient auth rather than raw headers.
Structs§
- Config
- Configuration for the vLLM OAI-compatible adapter.
Functions§
- register
- Explicitly register the vLLM adapter factory.