Skip to main content

Module client

switchyard_llm_client

Module client 

Source
Expand description

TranslatingLlmClient — the crate’s single public entry point: encode a neutral request, call the configured backend over HTTP, decode the neutral response.

Structs§

ModelConfig
How one model is served: the default_backend used when the request does not pin a wire format, plus any other_backends reachable over additional formats.
TranslatingLlmClient
A client that dispatches neutral-IR requests to per-model HTTP backends.